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FOREWORD 


The  Navy  intends  to  publish  an  annual  report 
illustrating  people-related  research,  development,  test, 
and  evaluation  (RDT&E).  This  is  the  first  such  report 
and  includes  significant  research  from  fiscal  years 
1975  through  1977.  The  development  of  this  report 
was  coordinated  by  the  Navy  Personnel  Research  and 
Development  Center  (NPRDC).  San  Diego,  California, 
and  the  manuscript  was  prepared  by  BioTechnology, 
Inc.,  Falls  Church,  Virginia,  under  contract 
N66001-78-C-0072.  The  annual  report  emphasizes 
utilization  of  people-related  RDT&E  and  contains 
(1)  examples  of  results  already  in  use,  (2)  advances  in 
the  technology  base  for  near  future  use,  and  (3)  cur- 
rent activities  designed  to  increase  RDT&E  utiliza- 
tion. 

RDT&E  funding  for  people-related  research  is 
provided  on  the  basis  that  research  and  development 
results  can  significantly  impact  on  the  operational 
readiness  of  naval  forces  by  ( 1 ) providing  the  tech- 
nology for  efficient  management  and  utilization  of 
Navy  personnel  and  (2)  improving  the  performance  of 
personnel  and  Navy  weapon  systems.  This  assumption 
of  operational  utility  for  RDT&E  results  has,  over  the 
years,  sustained  the  growth  and  confidence  in  re- 
search and  development  support.  Recently,  however, 
this  assumption  has  come  under  increasing  scrutiny 
by  policy  makers  within  the  Department  of  Defense 
(DOO)  and  in  the  Congress.  Considerable  interest  and 
emphasis  is  being  placed  on  making  the  research 
organization,  and  thereby  the  researcher,  “account- 
able'* and  on  making  more  research  products  “use- 
ful." Key  decision  makers  are  asking  for  confirmation 
that  people-related  RDT&E  is,  in  fact,  utilized  to 
impact  the  operational  readiness  of  naval  forces. 


In  1975,  the  House  Appropriations  Committee 
asked  the  General  Accounting  Office  (GAO)  to 
review  human  resources  R&D  in  DOD.  The  GAO 
issued  a report  in  April  1977  and  recommended, 
among  other  things,  that  DOD  improve  its  manage- 
ment system  to  increase  the  exchange  of  information 
between  researcher  and  user.  This  annual  report  of 
RDT&E  utilization  represents  one  of  the  actions  the 
Navy  has  initiated  in  response  to  the  recommenda- 
tions made  by  the  GAO. 

This  report  has  not  been  prepared  for  researchers. 
The  target  audience  is  primarily  policy  decision 
makers  within  DOD,  key  legislative  personnel  of 
appropriate  congressional  committees,  and  users  or 
sponsors  from  Navy  operational  and  training  com- 
mands. 

This  report  does  not  cover  the  entire  people-re- 
lated RDT&E  program  of  the  Navy.  The  examples 
presented  in  the  report  are  intended  to  show  signif- 
icant and  interesting  cases  of  RDT&E  utilization  or 
technology  base  advancement.  'However,  the  ex- 
amples used  are  not  unique  — they  are  representative 
of  the  people-related  RDT&E  performed  continually 
by  the  Navy. 

Appreciation  is  extended  to  the  official  points  of 
contact  representing  each  of  the  contributing  com- 
mands. 
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INTRODUCTION 


This  report  concerns  people-related  research,  de 
velopment.  test,  and  evaluation  (RDT&E)  in  the 
Navy.  People-related  RDT&E  is  a popularized  term 
that  has  come  into  use  in  the  last  few  years  to  refer  to 
RDT&E  activities  that  can  be  organized  into  four 
technical  areas: 

• Manpower  and  Personnel  Technology 

• Human  Factors  in  Weapon  Systems 

• Education  and  Training  Technology 

• Training  Devices  and  Simulators. 

In  short,  people-related  RDT&E  is  concerned  with 
R&D  activities  to  enhance  the  attitudes  and  perform- 
ance of  Navy  personnel. 

The  Need  for  People  Related  RDT&E 

People-related  RDT&E  probably  had  its  origin  in 
the  selection  and  classification  testing  during  World 
War  I.  Since  then,  the  scope  has  broadened  to  include 
all  of  the  aspects  of  personnel  attitudes  and  perform- 
ance suggested  above.  The  ultimate  goal  or  applica- 
tion of  people-related  RDT&E  is  to  make  Navy  per- 
sonnel more  effective  and  satisfied  in  their  jobs, 
thereby  enhancing  overall  Navy  readiness. 

People- related  RDT&E  is  currently  funded  as  part 
of  the  Training  and  Personnel  Technology  budget 
area  within  the  Office  of  the  Director  of  Defense  Re- 
search and  Engineering,  and  is  a portion  of  the 
Science  and  Technology  Program  of  that  office.  The 
need  for  people-related  RDT&E  can  be  inferred  from 
statements  in  the  Department  of  Defense  annual  re- 
port for  FY  79  by  Secretary  of  Defense 
Harold  Brown.  The  following  excerpt  appears  under 
tf>e  heading  of  Readiness'. 

I consider  our  forces  to  be  ready 
when  they  are  well  trained,  have  modern 
unit  equipment  in  good  operating  order, 
hold  war  reserve  stocks  on  which  they 
can  draw  for  the  early  stages  of  any  con- 
flict and  are  capable  of  timely  response  to 
crisis.  Unfortunately,  I cannot  report  that 
our  forces,  by  this  definition,  are  as  ready 
as  I would  like  them  to  be. 

There  are  several  reasons  for  the  cur- 
rent state  of  affairs.  Our  necessary  efforts 


to  conserve  fuel  have  meant  reductions  in 
ground  combat  training  exercises.  Navy 
steaming  hours,  and  flying  hours  for  all 
services  (although  we  have  been  able  to 
make  some  substitutions  for  these  losses, 
using  simulators).  Modernization,  in  some 
cases,  has  brought  with  it  shorter  mean- 
times  to  failure,  longer  repair  times,  and 
increased  training  requirements,  as  well  as 
greater  sophistication  and  capability  of 
equipment.  Inflation,  increased  pay,  and 
the  need  to  modernize  our  forces  have 
meant  curtailed  funds  for  operation  and 
maintenance. 

The  conventional  wisdom  has  been 
that,  in  an  emergency,  the  neglect  of 
readiness  can  be  quickly  overcome  by  a 
rapid  infusion  of  resources.  Whatever 
merit  this  wisdom  may  have  had  when 
the  United  States  had  ample  time  for  ex- 
tended mobilization,  it  is  now  out  of 
date. 

We  have  not  yet  developed  the 
methodological  tools  to  show  the  precise 
sensitivity  of  readiness  to  changes  in  our 
commitment  of  resources.  But  loss  of 
readiness  is  a cumulative  process  that 
takes  time  as  well  as  money  to  reverse. 

In  the  above  excerpt.  Secretary  Brown  acknowl- 
edges (1)  a concern  for  our  current  state  of  readiness, 
(2)  that  modern  equipment  may  in  fact  be  more 
sophisticated,  and  (3)  loss  of  readiness  is  a cumulative 
process  that  takes  time  as  well  as  money  to  reverse. 
The  third  point  is  perhaps  the  most  important  with 
respect  to  the  need  for  people-related  RDT&E.  Pei 
sonnet  readiness  is  dependent  on  all  four  technical 
areas  of  people-related  RDT&E,  viz.,  (l)Manpowei 
and  Personnel  Technology,  (2)  Human  Factors  in 
Weapon  Systems,  (3)  Education  and  Training  Tech 
nology,  and  (4)  Training  Devices  and  Simulators. 
Each  of  these  four  areas  must  be  continually  ad- 
vanced and  applied  and  cannot  be  handled  with 
"quick-fix"  technology.  Since  people- related  RDT&E 
is  not  nearly  as  familiar  an  activity  as  the  physical  and 
engineering  sciences,  mathematics,  or  environmental 
science,  more  clarification  of  its  importance  to  the 
Navy  seems  in  order. 
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Importance  of  People  Related  RDT&E 

Fust,  consular  the  overall  purpose  ol  people  re 
lated  RDT&E.  As  stated,  in  a recent  report  hv  the 
General  Accounting  Office  (GAOI,  that  purpose  "is 
to  develop  techniques,  methods,  and  procedures  for 
the  most  effective  use  of  military  personnel  at  the 
least  cost  " It  is  deceptively  simple  to  say  that  our 
military  personnel  development  must  be  cost  ettec 
live  Two  unique  tacts  must  be  recognized.  First,  mili 
tary  personnel  are  an  integral  part  of  our  defense  pos 
ture,  and  second,  the  performance  and  attitudes  of 
military  personnel  can  be  enhanced  just  as  the  per 
fotmance  and  reliability  of  hardware  can  be  en 
hanced.  The  importance  of  these  two  facts  is  briefly 
elaborated  below  to  clarify  the  impact  of  people-re- 
lated RDT&E  in  the  military. 

ftsople  related  ROT&E  is  a small  part  of  the 
RDT&E  budget  (less  than  1%),  but  a proportionally 
larger  part  of  our  superior  defense  posture,  mam 
tamed  by  research  and  development  achievements.  In 
support  of  this  statement,  consider  the  following 
rationales: 

e There  is  general  agreement  that  the  Soviets 
have  numerical  superiority  in  weapons,  hut 
this  is  offset  by  our  technology -base  strength. 
This  technology  strength  is  not  in  hardware 
alone,  but  in  people -related  sciences  as  well. 
Recent  history  has  substantiated  the  fact  that 
a small,  well  trained,  and  highly  motivated 
military  force  can  overcome  an  adversary  with 
far  greater  numerical  superiority  in  troops  and 
weapons. 

• Military  readiness  is  composed  of  two  maioi 
elements,  namely,  personnel  and  material. 
Further,  personnel  readiness  is  a function  not 
only  of  training,  but  also  of  other  people  re 
lated  RDT&E  products,  such  as  the  selection 
process,  human  engineering  (that  is,  the 
people  material  interface),  technical  manuals 
and  other  documentation,  and  the  motivation 
and  morale  of  individuals  and  units.  The 
readiness  and  reliability  of  our  weapon  and 
support  systems  can  be  no  greater  than  the 
readiness  and  reliability  of  the  personnel  who 
operate  and  maintain  them  Manpower  and 
organ  national  effectiveness  must  be  con 
tinuelly  monitored  and  upgraded.  The  DOD 
annual  report  for  FY  78  states:  "U.S.  defense 
needs  are  best  met  by  long  term  stability  in 
the  military  force  structure  ” A few  para 
graphs  later  it  is  further  stated:  "if  we  are  to 
attract  and  retain  quality  people  within  a 
force.  U.S.  military  personnel  management 
efforts  must  be  carefully  balanced  between 
maintaining  the  attractiveness  of  service  life 
and  minimizing  costs.”  It  is  common  knowl- 


edge that  there  have  been  scnous  problems 
with  respect  to  personnel  turnover  and  per 
sonnet  turbulence  in  the  Armed  Forces.  Man 
power  problems  such  as  these  will  only  (re 
resolved  through  solutions  ansrirg  from 
people  related  HDT&E 

• The  cost  ol  military  naming  now  exceeds 
$7  billion  a year.  These  training  costs  must  be 
reduced  without  sacrificing  the  benefits  from 
training  programs.  Research  and  development 
to  identify  more  cost-effective  training  meth 
ods  and  techniques  is  & key  element  of  the 
RDT&E  budget  for  training  and  personnel 
technology . 

• The  complexity  and  sophistication  of  military 
hardware  has  been  accelerating  since  the  end 
of  World  War  II.  Yet,  the  capabilities  of  the 
military  personnel  who  must  operate  and 
maintain  this  hardware  have,  at  best,  re 
mained  constant  and  perhaps  even  diminished 
since  the  advent  of  the  all  volunteer  military. 
The  man-equipment  match  is  becoming  more 
strained  every  year  amt  will  only  become 
more  compatible  through  the  application  of 
innovative  techniques  for  human  performance 
enhancement  resulting  from  people  related 
RDT&E.  , 

e Finally,  the  lowered  birthrate  of  the  1960's 
and  1970's  will  result  in  a military  age  man 
power  pool  that  will  shrink  by  15%  in  1985 
and  by  25%  in  1992.  The  inevitable  shortage 
of  numbers  and  skills  of  people  available  to 
the  Navy  will  create  severe  problems  that  can 
be  lessened  by  people-related  RDT&E.  Other 
wise,  the  possibility  of  a return  to  the  draft  or 
a significant  increase  in  the  defense  budget 
looms  as  an  unwanted  consideration. 

Research  Progress,  limitation,  and  Transfer 

The  first  sentence  of  this  introduction  stated  that 
this  report  is  about  people  related  RDT&E.  The  inter 
veiling  material  was  presented  to  clarify  what  people- 
related  RDT&E  in  fact  is,  and  why  it  is  important  to 
the  overall  defense  posture.  The  Navy  recognizes, 
however,  that  it  is  not  enough  to  conduct  people-re- 
lated RDT&E.  The  results  must  be  utilized  by  the 
operational  or  training  commands.  Research  utiliza- 
tion is  not  a matter  of  course.  Utilization  of  research 
tvquires  planned  efforts  to  interpret,  communicate, 
and  implement  the  results.  Some  current  Navy  ectiv 
ities  tor  increasing  RDT&E  utilization  are  discussed  in 
the  final  section  of  this  report. 

In  addition  to  planning  for  utilization,  it  is  neces 
sary  to  plan  for  research  progress.  In  essence,  this 
means  initiating  research  projects  which  will  advance 
the  technology  base  and  minimize  the  gap  between 


operational  needs  (utilization)  and  the  people-related 
technology  base  available  to  address  those  needs. 
Therefore,  a significant  portion  of  the  budget  for 
Training  and  Personnel  Technology  is  dedicated,  and 
needed,  lor  advancement  of  the  technology  base  Fi 
nafly.  research  today  is  continually  assessed  for  its 
potential  transfer  to  other  applications.  The  intrinsic 
value  of  an  RDT&E  program  must,  therefore,  include 
considerations  of  research  progress,  utilization,  and 
transfer.  The  body  of  this  report  thus  consists  of  ex 
amples  of  (1)  research  utilization  or  applications  and 
(21  technology  base  advancement.  Technology  trans 
fer  potential  is  discussed  in  both  types  of  examples. 
Each  of  these  areas  is  essential  to  obtain  the  maxi- 
mum payoff  from  RDT&E  efforts.  Definitions  of 
these  areas  are  provided  in  the  following  outline: 
a Research  Utilization  or  Application 

Any  change  involving 

— Initiation  or  modification  of  regulations, 
orders,  doctrines,  policies,  or  manuals 

- Development  or  change  of  courses  of  in- 
struction or  training  programs 

- Development  or  modification  of  equip- 
ment 

• Technology  Base  Advancement 

Any  advancement  of  the  state-of-the-art  in- 
volving 

- Basic  research  - scientific  study  and  ex- 
perimentation directed  toward  increasing 
knowledge  and  understanding  in  those 
fields  related  to  long-term  national  secu- 
rity needs.  It  provides  fundamental 
knowledge  for  the  solution  of  identified 
military  problems  and  furnishes  part  of 
the  base  for  subsequent  exploratory  and 
advanced  developments  in  defense-related 
Technologies  and  new  or  improved  mili- 
V ry  functional  capabilities. 

- Exploratory  development  - all  efforts  di- 
rected toward  the  solution  of  broadly  de- 


fined problems;  short  major  development 
programs  with  a view  to  developing  and 
evaluating  technical  feasibility 
Advanced  development  - all  projects  that 
have  moved  into  the  development  of  hard 
ware  for  test.  The  prime  result  of  this 
type  of  effort  is  proof  of  design  concept 
rather  than  the  development  of  hardware 
for  service  use.  Projects  in  this  category 
have  a potential  military  application. 

• Technology  for  Transfer 

Any  unique  research  data  or  applications 
available  for  transfer  to 
- Other  military  operations 
— Non-military  needs. 

This  introduction  has  attempted  to  define  peo 
pie  related  RDT&E,  clarify  its  impact  on  our  defense 
posture,  and  establish  the  framework  for  the  body  of 
this  report.  No  doubt  the  insightful  reader  will  also 
ascertain  that  this  introduction  has  tried  to  convey 
the  importance  of  future  support  for  people-related 
RDT&E.  Perhaps  there  is  no  better  way  to  close  this 
introduction  and  proceed  to  some  significant  ex 
amples  of  Navy  projects  than  to  quote  a respected 
source.  Following  is  the  concluding  paragraph  in  the 
epilogue  of  the  report  to  the  President  and  the  Con- 
gress. submitted  by  the  Defense  Manpower 
Commission  in  April  1978 

People  always  have  decided  battles. 

There  is  no  substitute  for  people  who  are 
courageous,  motivated,  prepared  and  will- 
ing. The  overwhelming  lesson  of  this  re- 
port is  that  human  considerations  now 
have  become  primary  in  planning  for  the 
Nation's  defense.  It  is  for  that  reason  that 
we  believe  without  hesitation  that  De- 
fense manpower  is  the  keystone  of  our 
national  defense. 
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RESEARCH  UTILIZATION  AND  TECHNOLOGY 
BASE  ADVANCEMENT  EXAMPLES 


This  section  of  the  repot;  contains  examples  of 
recent  (FY  75  - FY  77)  Navv  RDT&E  projects 
which  have  either  resulted  in  utilization  in  the  Fleet 
or  have  significantly  advanced  the  technology  base. 
All  of  the  examples  have  been  prepared  from  mate- 
rials or  data  supplied  by  the  performing  organization 
or  principal  investigator.  The  examples  have  been 
written  in  what  is  hopefully  a clear,  concise  style. 
Terminology  or  jargon  specific  to  the  research  com 
munity  has  been  eliminated.  The  emphasis  was  to 
illustrate  practical  accomplishments  rather  than  meth 
odology.  The  Program  Element  number  under  which 
each  project  was  funded  is  identified. 

For  ease  of  use,  the  examples  have  been 
organized  under  four  technical  areas  within  the 


RDT&E  program  in  Training  and  Personnel  Tech 
nology: 

• Manpower  and  Personnel  Technology 

• Human  Factors  in  Weapon  Systems 

• Education  and  Training  Technology 

• Training  Devices  and  Simulation. 

The  material  in  each  technical  area  is  preceded  by  a 
listing  of  the  examples  which  appear  in  that  section. 
As  stated  earlier,  these  are  representative  examples 
and  no  attempt  has  been  made  to  report  on  all 
people-related  Navy  RDT&E  performed  in  FY  75 
through  FY  77. 
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MANPOWER  AND  PERSONNEL  TECHNOLOGY 

• Naval  Academy  Selection  Procedures 

• The  Naval  Personnel  Pay  Predictor,  Enlisted  (NAPPE)  Model 

• Success  Chances  of  Recruits  Entering  the  Navy  (SCREEN) 

• Improved  Multifactor  Weighting  System  for  Enlisted  Advancement 

• Unbiased  Recruit  Assignment 

• Productivity  and  Motivation 

• Economic  Research  on  Navy  Manpower  Problems 

• Technique  for  Interactive  Systems  Analysis 

• Laboratory  Workforce  Planning  with  a Conversational  Manpower  Model 

• Career  Counseling 

• Force  Structure  Simulation  Model  (FAST)  Development 

• Conference  on  First  Term  Attrition 

• Conference/Survey  on  Cost-Benefits  of  Recreation 
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NAVAL  ACADEMY  SELECTION  PROCEDURES 


N*ed/Ob|ectives 

The  U.S.  Naval  Academy  is  a major  source  ot 
commissioned  officers.  Every  year,  over  800  midship- 
men are  commissioned.  Consequently,  it  is  important 
that  the  men  and  women  who  seek  admission  each 
year  are  carefully  screened  so  that  opportunities  are 
given  to  those  who  are  most  likely  to  succeed  at  the 
Academy  and  as  officers. 

In  the  past.  Academy  managers  regarded  the  rate 
of  voluntary  resignations  at  the  Naval  Academy  as 
too  high.  One  of  every  three  midshipmen  failed  to 
complete  Academy  training.  Furthermore,  the  per- 
centage of  candidates  selecting  engineering,  mathe- 
matics, and  science  majors  was  deemed  too  low  (be- 
low 80%)  to  meet  present  and  future  service  needs. 

The  project  initiated  to  address  these  problems 
had  dual  objectives.  THb  first  was  to  modify  the  selec- 
tion procedures  to  reduce  disenrollment  (losses) 
caused  by  academic  failure  and  personal  dissdffsf ac- 
tion. The  second  was  to  increase  the  proportion  of 
midshipmen  voluntarily  majoring  in  (and  remaining 
with)  engineering  and  science.  Funding  comes  from 
Program  Element  No.  63707N. 


Approach  and  Results 

The  Navy  Personnel  Research  and  Development 
Center  (NPRDC)  analyzed  all  disenrollment  records 
and  selection  procedures.  Recommendations  were 
proposed  for  consideration  by  the  Academy  Admis- 
sions Board,  and  two  selection  instruments  were  de- 
veloped. One  instrument  was  a Combined  Disenroll- 
ment Scale  (DIS)  designed  to  identify  those  ap- 
plicants most  likely  to  disenroll.  The  second  instru- 
ment was  an  Engineering-Science  (ES)  Scale,  based  on 
the  assumption  that  there  are  identifiable  and  measur- 
able differences  in  the  vocational  interests  of  midship- 
men who  would  voluntarily  choose  engineering  or 
science  majors  as  compared  tc  those  who  would 
choose  non-technical  majors. 


Utilization/Technology  Base  Advance 

Since  the  development  and  evaluation  of  the 
Combined  Disenrollment  and  Engineering-Science 
Scales,  both  have  been  adopted  by  the  Academy  for 
use  in  applicant  selection.  The  success  of  the  project 
is  perhaps  best  expressed  by  referring  to  a letter  to 
NPRDC  from  the  Superintena<..-t  of  the  Academy, 
Rear  Admiral  Kinnaird  R.  McKee.  Excerpts  from  the 
letter,  dated  29  October  1976,  follow: 

The  Admissions  Board  began  its  selec- 
tion of  the  Class  of  1981  on  21  October. 

The  procedures  in  use  by  the  Board  are 
based  on  the  Center's  analyses  of  the  per- 
formance of  previous  classes.  As  a result 
of  this  work,  we  have  a greater  confi- 
dence in  the  validity  and  reliability  of  our 
process  than  ever  before. 

The  development  and  confirmation  of 
validity  of  two  special  scales  used  in  scor- 
ing the  Strong  Vocational  Interest  Blank 
last  year  helped  us  to  exceed  our  goal  of 
80%  voluntary  enrollment  in  engineer- 
ing/science  majors  and  to  reduce  the  attri- 
tion of  midshipmen  below  that  reported 
for  any  class  at  any  other  service  acad- 
emy. 

The  Combined  Disenrollment  Scale  is  believed  to 
have  contributed  significantly  to  lowering  the  rate  of 
voluntary  resignations  in  the  classes  of  1977  and 
1978.  Also,  the  percentage  of  midshipmen  voluntarily 
selecting  an  engineering  or  science  major  increased 
from  70%  for  the  class  of  1977  to  80%  and  83.4%  for 
the  classes  of  1978  and  1979,  respectively. 

Payoff  /Potential 

The  potential  dollar  saving  from  using  the  new 
Scales,  thereby  reducing  the  number  of  disenrollees, 
has  been  calculated  at  more  than  $500,000  per  year. 
Also,  because  of  the  successful  use  of  the  Engineer- 
ing-Science Scale  for  selecting  midshipmen,  a similar 
scale  is  being  developed  for  application  to  the 
NROTC  Scholarship  Program.  As  in  the  Academy 
Program,  the  proportion  of  engineering  and  science 
students  in  the  NROTC  must  be  increased. 


PRECEDING  PjtOS  hi  Any 
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THE  NAVAL  PERSONNEL  PAY  PREDICTOR,  ENLISTED  (NAPPE)  MODEL 


1 


Need/Objectives 

Navy  planning  and  policy  are  marked  by  complex 
problems  and  conflicting  objectives.  One  such  prob- 
lem is  that  of  forecasting  the  Navy's  military  man- 
power budget  to  avoid  cost  overruns  and  personnel 
difficulties.  Cost  overruns  can  occur  as  a result  of 
inaccurate  estimates  of  either  the  personnel  force 
(personnel  arrayed  by  length-of-service  [LOS]  and 
pay  grade)  or  the  various  pay  rates.  To  control  for  the 
first  source  of  error,  forecasting  models  are  being 
developed  by  the  Navy  Personnel  Research  and 
Development  Center  (NPRDC)  to  predict  required 
obligations  based  on  a desired  or  allocated  man-year 
average  by  pay  grade. 

The  objective  of  this  effort  was  to  develop  a 
computer  model  to  be  used  by  the  Navy's  personnel 
managers  to  forecast  the  enlisted  force  structure 
based  on  longevity,  transition  rates,  and  the  costs 
associated  with  future  enlisted  population.  Funding 
comes  from  Program  Element  No.62763N. 

Approach  and  Results 

The  model,  which  is  being  used  to  monitor  the 
characteristics  of  the  force  and  its  cost  in  basic  pay,  is 
formally  known  as  the  Naval  Personnel  Pay  Predictor, 
Enlisted  (NAPPE).  NAPPE  relies  upon  U.S.  Navy  and 
U.S.  Naval  Reserve  force  structure  files  dating  back  to 
1957.  Selected  analysis  techniques  were  applied  to 
these  files  to  find  a particular  set  of  models  that 
would  be  appropriate  for  forecasting  the  LOS  distri- 
bution. Various  combinations  of  these  forecasts  were 
then  compared  to  obtain  a "best"  forecast  for  the 
distribution.  The  results  of  the  NAPPE  forecasts  are 
shown  in  Table  1 . As  indicated,  the  forecast  error  in 
the  last  three  fiscal  years  using  NAPPE  was  restricted 
to  less  than  0.20  of  1%.  It  is  estimated  that  previous 
methods  used  for  forecasting  estimated  basic  pay 
resulted  in  errors  of  about  1%  — which  amounts  to 
about  $30  million  in  terms  of  the  current  budget. 

Utilization/Technology  Base  Advance 

Althr»igh  the  NAPPE  model  has  been  imple- 
mented operationally,  it  is  currently  undergoing 
further  development  that  should  increase  both  its 


accuracy  and  ease  of  usage.  In  addition,  plans  have 
been  made  to  extend  its  scope  so  that  it  can  be 
applied  to  budget  elements  other  than  enlisted  basic 
pay. 

The  Chief  of  Naval  Personnel  cannot  exceed 
budge’  appropriations,  and  he  must  therefore  be 
cautious  with  respect  to  personnel  management  ac 
tions.  Since  NAPPE  results  in  less  forecasting  error,  it 
helps  to  avoid  problems  such  as  reducing  enlistments, 
encouraging  early  attrition,  and  delaying  promotions. 


Table  1 

NAPPE  Validation: 

Percent  Error  in  Forecasting  Basic  Pay 


Fiscal  Year 

Years  Forecast  From  Base 

1 

2 

3 

64 

.22 

65 

.10 

.61 

66 

.69 

.55 

06 

67 

.96 

2.38 

2.29 

68 

.29 

1.63 

3.15 

69 

.37 

.75 

2.34 

70 

.36 

.72 

.96 

71 

.37 

36 

29 

72 

.51 

82 

.49 

73 

.18 

80 

1.11 

74 

.12 

.60 

1.27 

75 

.14 

.23 

.37 

Mean  Error 

.35 

.84 

1.23 

Payoff /Potential 

The  NAPPE  model  for  personnel  budget  foncatt- 
ing  is  only  one  of  many  efforts  being  devoted  to 
improved  management  of  human  resources.  The 
model  could  be  expanded  to  include  forecasts  of 
other  enlisted  budgetary  components,  such  as  basic 
allowances,  etc.  Also,  the  Navy  could  develop  an 
officer  version  of  the  model  to  forecast  basic  pay  and, 
eventually,  other  officer  costs. 
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SUCCESS  CHANCES  OF  RECRUITS  ENTERING  THE  NAVY  (SCREEN) 


Need /Objectives 

The  Navy's  concern  about  the  increasing  number 
of  premature  fosses  df  first-term  personnel  prompted 
the  need  to  create  a recruit  screening  tool  to  pi  edict 
an  applicant's  chance  of  surviving  the  first  year  of 
service.  The  objective  of  this  study  was  to  develop  a 
model  for  estimating  premature  losses  in  order  to 
plan  recruiting  policy  and  screen  applicants  for 
enlistment.  Funding  comes  from  Program  Element 
No.  651 52N. 

Approach  and  Results 

The  project  was  funded  by  the  Office  of  the  Chief 
of  Naval  Operations  and  conducted  under  the  direc- 
tion of  the  Center  for  Naval  Analyses.  Modeling 
efforts  were  utilized  to  produce  the  SCREEN  table. 
The  table  is  used  to  predict  the  chances  of  completing 
the  first  year  of  service  based  on  education,  mental 
group,  age,  and  dependent  status  of  Navy  reciuits. 
The  SCREEN  table  was  originally  developed  from 
loss  rates  obtained  by  tracking  < a group  of  recruits 
through  the  first  year  of  service.  A follow-on  study 
showed  that  the  predicted  survival  chances  developed 
from  the  SCREEN  model  on  the  original  group  of 
recruits  corresponded  to  their  actual  first  year 
completion  rate.  In  April  1977,  a re-analysis  of  the 
variables  in  the  SCREEN  model  was  performed  to 


compensate  for  changes  in  minority  recruiting 
policies. 

Utilization/Technology  Bate  Advance 
Navy  personnel  planners  currently  use  SCREEN 
in  planning  recruiting  policies  with  respect  to  the 
quality  of  accessions  and  in  managing  losses  during 
the  first  year  of  service.  This  study  is  being  continued 
by  tracking  the  model  group  through  the  fourth  year 
of  service  to  examine  the  effects  of  service  experience 
on  premature  loss  rates.  If  certain  patterns  of  training 
assignment,  performance,  and  skill  specialties  are 
related  to  continuation,  an  in-service  SCREEN  can  be 
developed  to  capitalize  on  these  patterns  for  use  in 
enlisted  classification,  distribution,  and  separation 
policy. 

Payoff /Potential 

The  use  of  the  SCREEN  table  to  minimize  first 
year  losses  also  results  in  decreased  recruiting  require- 
ments. This  is  evident  from  a $3  million  decrease  in 
attrition  costs  with  no  accompanying  increase  in 
recruitii-  nosts  for  FY  77.  Further,  any  improvement 
in  this  los.  'xperience  results  in  cost  savings  with 
respect  to  training  investment.  Modified  versions  of 
this  system  also  have  the  potential  for  identifying 
probable  first  year  losses  for  the  other  services. 


9 


IMPROVED  MULTIFACTOR  WEIGHTING  SYSTEM  FOR  ENLISTED  ADVANCEMENT 


Need/Objectives 

The  selection  of  the  best  qualified  candidate  for 
promotion  has  been  a long  standing  and  continuous 
concern  of  the  Navy  The  ramifications  of  the 
selection  process  extend  into  the  aiea  of  retention 
rates,  morale,  and  effectiveness  of  enlisted  personnel, 
in  general,  and  of  minority  personnel,  in  particular. 
Accordingly,  in  FY  72,  the  Navy  Personnel  Research 
and  Development  Center  (NPRDC)  initiated  a project 
to  analyze  the  existing  promotion  procedures  and  to 
investigate  alternative  promotion  methods.  The  objec- 
tives of  the  research  were  to  maximize  the  effective- 
ness of  those  enlisted  personnel  in  positions  of 
increased  authority  at  the  higher  pay  grades  and  to 
maximize  equal  opportunity.  This  was  to  be  ac- 
complished through  the  development  of  improved 
weighting  procedures  for  a mix  of  such  factors  as 
knowledge,  job  performance,  and  seniority.  Funding 
comes  from  Program  Element  No.  62763N. 

Approach  and  Results 

The  approach  to  the  project  applied  iterative 
techniques  to  multiple  factor  statistical  analysis  to 
achieve  the  precise  quantitative  weighting  of  selected 
promotion  factors.  One  of  the  subsequent  promotion 
systems  was  then  used  to  select  advancements  to  pay 
grades  4,  5.  and  6.  Another  procedure  was  developed 
and  used  by  a selection  board  to  screen  candidates  for 
advancement  to  pay  grades  7,  8.  and  9. 

Generally,  the  improvements  in  the  weighting 
technique  increased  its  effectiveness  as  a selection 
device.  The  results  indicated  that  the  candidates 
selected  were  better  qualified  in  terms  of  all  the 
factors  than  those  selected  by  the  old  weighting 
procedures. 

Comparison  of  a Black  minority  enlisted  group 
with  the  White  majority  group  showed  that  the 
relative  percentage  of  eligible  Black  personnel  receiv- 
ing promotions  for  pay  grades  5 and  6 increased 
significantly  when  the  weighted  promotion  technique 


was  applied.  Pay  grade  5 promotions  increased  tiom 
67  to  84%  when  compared  to  the  White  gioup;  at  pay 
grade  6,  the  lelative  percentage  changed  from  50  to 
100  foi  the  Black  gioup.  This  lesult  is  lielieved  to  Imi 
one  of  the  most  substantial  improvements,  empui 
cally  evaluated  and  documented,  for  any  management 
or  research  and  development  approach  to  improving 
equal  opportunity. 

Utilization/Technology  Baae  Advance 

As  a result  of  the  project,  more  emphasis  has  been 
placed  on  the  recognition  of  "on-the-job  perform- 
ance" as  one  of  the  promotion  criteria.  The  cut-off 
scores  on  technical-knowledge  examinations  were 
reset  at  levels  which  improved  the  opportunities  for 
candidates  to  compete  on  the  basis  of  other  factors  as 
well.  More  emphasis  has  been  placed  on  experience 
(i.e.,  seniority,  awards,  medals,  etc.),  leadership 
capabilities,  and  quality  of  performance,  with  increas- 
ing weight  applied  to  the  performance  factor  in  the 
higher  pay  grades. 

Implementation  of  the  new  selection  techniques 
also  permitted  discontinuation  of  the  time-con- 
suming, manual  procedures  of  the  Meritorious  Selec- 
tion Board.  This  Board  met  annually  to  select  a small 
number  of  "meritorious"  candidates  who  had  not 
been  advanced  in  five  or  more  tries. 

This  weighted  promotion  technique  was  de- 
veloped and  tested  on  the  total  Navy  enlisted 
population  competing  for  advancement,  which  repre- 
sents the  limits  of  possible  utilization  in  the  Navy. 

Payoff  /Potential 

There  are  no  hard  figures  presently  available  to 
assess  the  contributions  of  the  weighted  promotion 
system  to  readiness,  training,  and  the  overall  effec- 
tiveness of  Navy  personnel.  However,  promotion  of 
better  qualified  personnel  usually  increases  such 
intangibles  as  motivation,  personal  pride,  and  esprit 
de  corps  which  can  positively  affect  retention. 
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UNBIASED  RECRUIT  ASSIGNMENT 


Need/Objectives 

The  pre  1972  Manne  manpower  assignment  pol 
icy  (ailed  to  consider  race  as  a factor  in  assigning 
recruits  to  (raining  schools.  The  system  tended  to 
assign  more  minority  personnel  to  “soft"  skill  train- 
ing areas  than  to  more  highly  technical  areas.  This 
unintentional  imbalance  came  about  because  the 
assignment  methods  selected  individuals  in  terms  of 
absolute  measured  qualifications;  this  resulted  in  an 
assignment  system  that  was  detrimental  to  personnel 
who  were  fully  qualified,  but  to  a lesser  extent.  Some 
undesirable  consequences  were  that  minority  per 
sonnel  had  fewer  opportunities  to  acquire  skills 
transferable  to  later  civilian  careers,  more  exposure  to 
comba*  assignments,  and  more  morale  and  disci- 
plinary problems. 

The  objective  of  this  project  was  to  develop  a 
computer-based  recruit  assignment  system  for  the 
Marine  Corps  that  would  guarantee  an  unbiased  (i.e., 
fair  to  minority  personnel)  matching  of  individual 
skills  with  post-boot  camp  training.  Funding  comes 
from  Program  Element  No.  62757N. 

Approach  and  Results 

The  Office  of  Naval  Research  funded  a 2 year 
research  effort  to  accomplish  this  objective.  The 
research  methods  used  included  a systems  analysis 
approach,  computer  programming,  and  probability 


modeling.  The  contractor  developed  a mathematical 
method  to  improve  the  existing  recruit  assignment 
system.  In  part,  this  was  made  possible  by  accepting 
the  concept  that  race  is  a valid  characteristic,  nec 
essary  to  the  recruit  assignment  process. 

Utilization /Tech  oology  Bate  Advance 

This  "fair  share  of  minorities"  facet  of  the 
Marines'  Computer  Based  Recruit  Assignment 
(COBRA)  system  is  now  an  integral  part  of  the 
operational  system.  It  has  been  incorporated  with 
out  compromising  the  overall  quality  of  skill  in  the 
Marine  Corps.  Minority  personnel  who  meet  the 
minimum  qualifications  are  now  considered  for 
assignment  to  "hard  skill"  technical  schools,  while 
all  unqualified  personnel  remain  ineligible  for  such 
training. 

Payoff /Potential 

The  new  system  has  been  adopted  throughout 
the  Marine  Corps  and  has  resulted  in  an  increased 
racial  balance  among  all  military  occupational 
specialties,  and  this,  in  turn,  should  have  a marked 
effect  on  motivation,  morale,  utilization  of  skills, 
and  attrition  rates  throughout  the  Corps.  High 
attrition  escalates  recruiting  requirements  and  brings 
about  waste  in  the  form  of  unoccupied  school  seats; 
its  most  extreme  effect  is  to  reduce  readiness  be- 
cause not  enough  people  are  available  to  man 
critical  billets. 


continue  to  escalate  This  project  was  an  exploratory 
development  allot t to  determine  the  leasibility  of 
extending  theoietical  assumptions  concerning  human 
performance  and  productivity  into  actual  work 
settings  The  research  directly  addressed  the  effect 
that  various  organizational  and  peisonnel  factors  have 
upon  individual  productivity. 

The  objective  of  this  project  was  to  develop  a 
performance  model  for  predicting  individual  produc- 
tivity and  diagnosing  the  effect  of  organizational 
reward  systems.  Funding  comes  from  Program  Ele- 
ment No.  62763N. 

Approach  and  Results 

During  FY  76.  scientists  at  the  Navy  Peisonnel 
Research  and  Development  Center  (NPRDC)  began 
the  development  of  a performance  prediction  model 
based  upon  an  assessment  of  individual  ability  and 
motivation  to  work.  Dunng  that  year  and  FY  76,  the 
model  was  applied  to  clerical  workers  to  determine 
whethei  it  could  accurately  account  foi  their  current 
rates  of  performance.  The  model  did  account  foi 
individual  productivity  with  a fairly  high  degree  of 
accuracy.  Furthermoie,  the  methods  employed 
identified  specific  factors  responsible  for  high  and 
low  levels  of  productivity  in  particular  jobs. 

Changes  in  performance  were  evaluated  following 
the  design  and  implementation  of  an  incentive  man 
agement  program  foi  several  similar  work  groups.  One 
such  evaluation  analyzed  the  performance  of  a 
keypunch  section  of  a naval  data  processing  depart- 
ment. The  performance  model  predicted  that  when  a 
reward  is  made  contingent  on  a particular  and 
reasonable  performance  level,  individuals  will  strive  to 
achieve  the  performance  level  to  gain  the  reward.  The 
rewards  included  monetary  bonuses  foi  performance 
that  exceeded  predetermined  work  standards.  The 
amount  of  these  bonuses  was  related  to  the  degree  by 
which  standards  were  exceeded. 

As  a direct  result  of  the  implementation  of  the 
performance  prediction  models,  the  daily  work  back 
log  of  the  keypunch  center  was  reduced  to  neat  zero 


key  stroke  rate  averages  were  increased  during  the 
incentive  period  from  approximately  8500  key 
strokes  per  hour  to  approximately  10,200  pei  hour 
(Figure  3). 


Figure  1.  Work  Backlog  in  Barents  Par  Day 
tor  the  Pra  incentive  and  incentive  Periods 
t Ft  educed  backlog  in  Dacambar  mi  dua  to  a reduced  work 
volume  associated  wilt)  shipyard  cloture  during  that  month) 


SEPT  OCT  NOV  OEC  JAN  EEB  MAH  APR  MAV 


Figure  2.  Average  Weakly  Overtime  Hours 
for  the  Kay  Cntry  Section  during  the  Pre-incentive 
and  Incentive  Pariods. 
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Utilization/T echnology  Ba»e  Advanoa 

The  keypunch  center  pioject  represents  the  first 
application  of  the  performance  prediction  model  in 
government  and  military  settings.  The  usefulness  of 
the  model  has  been  demonstrated  with  a restricted 
variety  of  organizational  changes.  Future  efforts  will 
expand  the  number  of  tasks  being  examined  in  larger 
and  more  complex  organizations. 

More  recent  utilizstion  was  reported  by  Mare 
Island  Naval  Shipyard  in  a letter  dated  January  10, 
1978: 

This  shipyard  implemented  the  per 
formance  contingent  reward  system  in 
the  Data  Entry  Section  of  the  Computer 
Operations  Division  on  1 April  1977.  In 


addition  to  the  monetary  lewaid  pio 
vided  to  the  employees,  theie  has  been  a 
noticeable  improvement  in  moiale,  a re 
duction  in  turnover,  and  reduced  ab 
sences.  There  are  a number  ot  othei 
management  benefits  resulting  from  this 
progiam  of  which  increased  productivity 
is  the  most  significant.  Meaningful  stand 
aids  have  been  developed  and  im 
plemented  to  piovide  methods  of  measur 
ing  operatoi  pei  formance,  predicting 
workload,  scheduling  workload,  and  to 
insure  an  equal  distribution  of  workload 
to  employees.  These  standards  also  pro 
vide  the  base  upon  which  the  monetary 
awards  are  calculated.  As  a result  ot  oui 
experience  with  this  program,  it  is  highly 
recommended  as  an  effective  tool  for  the 
management  of  ADP  Data  Entry  which 
provides  an  appropriate  incentive  to  em 
ployees  tor  increased  productivity. 


Payoff /Potential 

Using  the  first  quarter  1977  data,  a forecast  was 
made  that  the  Long  Beach  Naval  Shipyard  would 
realize  a modest  $1,360  cost  saving  in  1977  even  after 
all  start  up  costs  for  the  project  were  written  off. 
This,  however,  was  pn  underestimate  since  efficiency 
continued  to  climb  after  the  first  quarter.  Using  the 
initial  forecast  and  extending  the  results  to  the  other 
Navy  shipyards,  savings  of  $508,000,  $1,700,000, 
and  $3,200,000  have  been  projected  for  1,  3,  and  5 
years,  respectively.  Experience  with  a similar  project 
at  the  Mare  Island  Naval  Shipyard  indicates  that  the 
forecast  is  conservative. 
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ECONOMIC  RESEARCH  ON  NAVY  MANPOWER  PROBLEMS 


Need/Otojectives 

The  end  of  Ihe  draft  brought  about  a broad  range 
of  technical  and  operational  problems  associated  with 
recruiting  and  other  manpower  functions  within  the 
Navy  and  Marine  Corps.  In  response  to  this,  the 
Office  of  Naval  Research  initiated  a project  to  address 
the  following  issues: 

• The  development  of  a system  to  forecast  the 
force  strength  of  the  Marine  Corps  in  the  face 
of  attrition 

• Identification  of  factors  influencing  the  ca 
pacify  for  training  and  retention 

• Assessment  of  the  combat  arms  bonus  offered 
to  Marine  enlistees  in  certain  occupational 
categories. 

Funding  comes  from  Program  Element  No.  62763N. 

Approach  and  Results 

Econometric  modeling,  computer  analysis,  statis- 
tical analysis,  and  file  building  were  used  to  compile 
and  analyte  the  information  gathered  throughout  the 
project. 

One  product  of  the  research  was  a "maximum 
likelihood  model”  that  forecasts  the  force  structure 
(sire)  of  the  Marine  Corps  under  realistic  conditions 
of  attrition.  The  method  provides  accurate  projec- 
tions up  to  12  months. 

Another  outcome  of  this  research  was  the  de- 
velopment and  application  of  a contingency  table 
approach  to  determining  recruiting  policies  with 


regard  to  age  and  prior  education.  Retention  was 
shown  to  be  most  influenced  by  educational  level, 
i.e..  possession  of  a high  school  diploma.  Prior  educa- 
tional attainment  was  also  predictive  of  trainability. 

The  combat  arms  bonus  offered  by  the  Marine 
Coips  proved  to  be  ineffective  in  increasing  the  total 
supply  of  manpower,  the  investigators  concluded  that 
the  same  individuals  would  have  eventually  entered  a 
combat  arms  unit  without  the  bonus. 

Utilization/T echnology  Bata  Advance 

The  results  of  the  project  have  prompted  the 
Marine  Corps  to  use  the  maximum  likelihood  model 
to  provide  quantitative  recruiting  objectives  that  can 
be  adjusted  as  the  forecasts  change.  The  findings 
relative  to  education  as  a predictor  of  retention  and 
education  as  an  indicator  of  trainability  were  imple 
mented  in  new  Marine  Corps  policies: 

a Increased  quotas  were  set  for  high  school 
graduates. 

• Occupational  assignment  was  modified  to 
take  into  account  the  level  of  education. 

Pay  off /Potential 

The  modeling  techniques  and  filing  system  de 
veloped  for  and  used  by  the  Marine  Corps  have 
applications  to  Navy  manpower  problems.  In  addi 
tion,  the  statistical  programs  developed  during  the 
project  provide  powerful  tools  for  understanding  the 
implications  of  many  proposed  management  and 
policy  changes  within  the  services. 
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TECHNIQUE  FOR  INTERACTIVE  SYSTEMS  ANALYSIS 


Need/Ototectives 

Manpower  coses  continue  to  rise,  even  as  the 
personnel  inventory  declines.  The  need  toi  signifi 
cantly  improved  determination  and  allocation  ot 
manpowei  ie<|iiiiements  can  only  be  met  by  the  use 
ot  computet  models.  Although  systems  analysis  tiadi 
tionally  has  been  used  to  obtain  the  necessary  data 
tor  design  or  evaluation  ot  hardware  systems,  this 
analytic  capability  is  no  less  desnable  toi  "soft 
systems."  The  obiecttve  of  this  project  was  to  develop 
a Technique  tor  Interactive  Systems  Analysis  (TISA) 
as  an  analytic  tool  tor  the  design  and  management  of 
personnel  organizations  or  systems.  Funding  is  under 
the  aegis  of  the  Manpower  Requuements  and  Re 
sources  Control  System,  Program  Element 
No.  63707N. 

Approach  and  Results 

TISA  was  developed  by  the  Navy  Personnel 
Research  and  Development  Center.  It  permits  the  use 
ot  traditional  systems  analysis  methodologies 
(e  g.,  cost  benefit  analysis)  on  "soft"  systems  in  a 
computerised  and  conversational  manner  (Figure  1). 
For  example,  TISA  can  represent  a management 
information  system,  using  as  building  blocks  all  the 
significant  communications  data  (e.g.,  recurring  trans- 
missions of  flows  of  information)  that  comprise  the 
system.  It  uses  networking  algorithms  to  access  and 
structure  data  from  computer  files,  applies  various 
analyses  to  these  data,  and  displays  resulting  system 
networks  by  computer  graphics  via  functional  block 
diagramming. 


fifurt  t.  TISA  Structvn. 


TISA  can  assist  manpowei  managers  in 

• Assessing  the  state  ot  the  current  system  at 
the  onset  of  a maior  development  effort 
(i.e.,  to  establish  a baseline) 

• Identifying  deficiencies  in  the  manpowei 
system  and  probable  candidates  for  further 
R&D 

• Providing  a convenient  and  effective  means 
tor  assessing  the  progress  of  a development 
effort  at  any  point  in  its  evolution. 

Utiliz  at  ion /Technology  Bata  Advance 

In  FV  76,  the  TISA  computer  package  was 
converted  from  the  POP- 10  computer  at  the  Brook 
ings  Institution  in  Washington.  D.C.,  and  made  opera- 
tional on  the  UN  I VAC  1110  computer  at  the  Naval 
Undersea  Center  in  San  Diego. 

TISA  has  been  used  within  the  Bureau  of  Naval 
Personnel  (DCNP  for  Management  Information, 
PERS-3)  to  assess  the  present  and  future  automated 
data  processing  requirements  of  that  organization.  The 
application  used  a data  base  which  included  more 
than  300  organizational  entities  which  collectively 
identified  more  than  600  communication  linkages  as 
necessary  to  the  performance  of  basic  operating, 
administrative,  and  planning  tasks.  The  same  data 
base  was  employed  to  uncover  strategies  and  con- 
straints concerning  possible  reorganization  and  an 
impending  move  of  part  of  the  Bureau  from  Washing 
ton,  D.C.  to  New  Orleans.  TISA  was  used  to  answer 
such  questions  as  “What  is  the  density  and  criticality 
of  communications  between  two  or  more  nodes  in 
the  organization?" 

TISA  was  also  delivered  and  made  operational  on 
the  UNIVAC  1108  computer  at  Lackland  Air  Force 
Base  in  FY  76.  Members  of  the  Air  Force  Human 
Resources  Laboratory  were  given  demonstrations  and 
training  sessions  on  TISA  to  assist  with  the  Air  Force 
Integrated  Simulation  Evaluation  Model  project.  Fi- 
nally, a TISA  user's  manual  was  completed  that  can 
be  used  as  an  operating  guide  and  a programmer's 
systems  reference. 

Payoff /Potential 

TISA  has  potential  as  a "data  management"  tool 
in  a management  information  system  or  resource 
management  system  development  effort. 
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LABORATORY  WORKFORCE  PLANNING 
WITH  A CONVERSATIONAL  MANPOWER  MODEL 


Need/Ofatectives 

With  the  current  emphasis  on  accurate  cost 
protections  within  the  Department  of  the  Navy, 
management  personnel  at  the  Naval  Unrfer water 
Systems  Centei  (NUSC)  are  concerned  with  those 
manpowei  policies  that  impact  on  ceilings,  budget, 
and  average  grade  of  the  work  force 

The  obiective  of  the  project  was  to  develop  a 
lecruiting  lequitements  model  which  would  predict  as 
closely  as  possible  a set  of  manpower  needs  foi 
NUSC  Further  intent  was  to  provide  the  technology 
to  permit  two  way  dialogues  between  the  manpowei 
analyst /manager  and  supporting  computoi  models  in 
a manner  which  would  allow  the  inputting  of 
appropriate  feedback  to  the  computer  generated 
model 

The  model  development  was  originally  carried  out 
by  the  Office  of  Civilian  Personnel.  Department  of 
the  Navy  NUSC  has  also  received  support  from  the 
Navy  Personnel  Research  and  Development  Centei 
Funding  conies  horn  Progiam  Element  No  63707N 

Approach  and  Results 

The  NUSC  has  developed  a number  of  tools  to 
accomplish  its  manpower  planning  Automated  per 
sonnet  data  systems,  statistical  data  and  tcpoits, 
integrated  financial  or  personnel  tiles,  and  long  tange 
staffing  plans  were  used  to  compile  information  and 
assess  the  utility  of  manpowei  planning  models 
Application  studies  have  been  under  way  since  1972 
One  of  the  most  promising  of  these  studies  is  the 
Conversational  Use  of  the  Recruiting  Requuements 
Model  (CURRM)  This  model  recommends  how  many 
people  must  be  hired/fued  considering  such  variables 
as  internal  transfers,  attrition,  and  budget  and  ceiling 
constraints. 

The  value  of  the  conventional  computet  im! 
model  is  that  alternative  solutions  can  Ire  quickly 
analyzed  undei  various  problem  constraints.  Thus, 
the  impact  of  different  policies  can  tie  nidged 


their  decisions,  and  to  discern  the  piobatrle  outcomes 
of  these  changes  By  leceiving  inputs  horn  designated 
sources,  they  are  able  to  estimate  protected  costs 
Figure  1 illustrates  the  system  information  flow 
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By  utilizing  the  current  conversational  version  of 
the  model,  the  management  of  NUSC  is  able  to 
monitor  trends  and  alternative  solutions  to  a variety 
of  manpowei  planning  strategies  The  Naval  Under 
water  Systems  Centei  finds  the  model  most  useful  for 
establishing  geneial  trends. 

Payoff  /Potential 

The  conversational  model  has  become  an  integial 
part  of  NUSC's  management  support  capabilities.  It 
has  been  useful  in  estimating  the  number  of  job  and 
billet  vacancies  expected  over  various  time  periods  so 
that  management  can  effectively  institute  hiring  and 
promotion  plans 


Utiliration/Technofogy  Base  Advance 

The  CURRM  model  was  rnrtalled  at  NUSC  in 
1976  and  is  now  fully  oper ational  It  is  the  mission  of 
the  model  to  allow  managers  to  apply  a given 
solution,  to  examine  its  effects,  to  make  changes  in 


The  conversational  model  can  be  adapted  foi  use 
with  new  technology  in  othei  systems  as  well, 
bringing  multi-period  planning  models  together  with 
organization  design  models  in  order  to  project 
individual  man  job  assignments. 
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CAREER  COUNSELING 


Need/Obtectivet 

With  the  initiation  nt  the  jll  volunteer  (nice,  the 
military  IouihI  »ts  maiHH'wei  isuiuiiyi  diminishing 
considerably  Navy  leenlistments  ywtn  at  j low  ot  less 
than  20%  As  4 insult,  the  Office  of  Naval  Reseaich 
suppoited  do  expanded  career  counseling  piogieni 
inteiHlesI  to  increase  the  proportion  of  qualified 
tint  tenners  who  leenlist.  The  objectives  of  this 
twoiect  were 

• To  develop  techniques  toi  identifying  fust 
teini  enlisted  personnel  who  possess  skills  and 
performance  records  desudble  in  the  cateei 
force 

• To  enhance  the  impact  of  division  officers 
and  enlisted  cateei  counselors  on  reenlistment 
decisions 

• To  assist  in  developing  a career  counseling 
system  with  special  emphasis  on  retdinmg 
highly  qualified  individuals 

Funding  comes  from  Piogiam  Element  No  6?763N 

Approach  and  Results 

Systems  analysis,  surveys  of  naval  personnel  and 
their  wives,  and  computet  simulation  of  the  cateei 
counseling  process  contributed  to  the  development  of 
an  effective  career  counseling  system.  Specifically, 
the  study  demonstrated  the  important  role  ot  wives 
in  leenlistment  discussions  and  decisions.  Fuithei 
more,  it  determined  that  large  proportions  of  critical 


groups  (97%  ot  the  wives  and  l>0%  of  the  lust 
tenneis)  weir  not  leached  tiy  the  oiigin.il  raieei 
counseling  piogtant  Gioup  cairn  counseling  tecfi 
niques.  individuali/ed  tiaining  technii|ues  foi  cairei 
rounselois,  and  automated  scheduling  and  tecoid 
keeping  prpceduies  wrie  among  the  measuies  de 
veloped  to  enhance  careri  counseling  effectiveness. 

Ut  M iration/T  ech  rsofogy  Base  Advance 

This  lesearch  program  was  a maioi  source  foi 
47  recent  mitiatrves  in  the  Management  By  Objectives 
(MBO)  system  ot  the  Chief  of  Naval  Operations  and 
Chief  of  Naval  Personnel.  Findings  from  this  study 
were  used  by  the  Bureau  of  Naval  Peisonnel  as  a basis 
tot  revising  the  Naval  Caieei  Counseling  Piogiam  The 
Navy  Reciuiting  Command,  the  Family  Studies 
Blanch  of  the  Naval  Health  Reseaich  Institute,  and 
the  other  military  seivices  have  also  utilized  the 
results  of  this  reseaich 

PayoH/Potential 

The  retention  tale  increased  from  20%  in  1972  to 
40%  in  1975,  exceeding  the  goal  set  by  the  Chief  of 
Naval  Operations.  Effective  caieei  counseling  which 
contributes  to  desiied  retention  rates  also  has  cost 
benefits  in  several  areas.  Recruiting  goals  can  he 
1 educed,  training  loads  for  basic  technical  skills  ate 
decreased,  and  mission  performance  ts  improved 
because  competent,  experienced  people  remain  in  the 
Navy. 
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FORCE  STRUCTURE  SIMULATION  MODEL  <F  AST)  DEVELOPMENT 


Need/Objectivet 

The  Bureau  ol  Naval -Personnel  has  a continuing 
need  to  determine  the  feasibility  of  attaining  man 
power  requirements  ami  the  long  term  effects  of 
personnel  policies.  Over  the  years,  many  separate 
techniques  or  methods  were  developed  and  used  to 
provide  answers  to  particular  personnel  planning 
issues  However,  the  interactions  of  the  separate 
issues,  particularly  when  extended  over  several  years, 
were  difficult  to  forecast.  Further,  it  was  similarly 
difficult  to  test,  in  advance,  the  implications  of  maiot 
personnel  policies.  What  was  needed  was  to  integrate 
many  of  these  needs  into  a simulation  model  with 
which  the  user  could  converse.  One  such  effort  is  the 
Force  Structure  Simulation  Model,  popularly  known 
as  FAST. 

The  obiective  of  FAST  is  to  simulate  the  flow  of 
active  duty  enlisted  peisonnel  through  the  force 
structure  to  reveal  problems  in  force  configuration, 
feasibility  of  meeting  manpower  objectives,  and 
budget  implications  of  current  or  proposed  policies 
FAST  was  developed  over  several  years  and  has  been 
used  extensively  by  Navy  planners.  Funding  comes 
from  Program  Element  No.  62763/63707N. 

Approach  and  Results 

The  Navy  Personnel  Research  and  Development 
Center  (NPRDC)  developed  the  initial  version  of 
FAST  in  1974.  The  enlisted  personnel  system  was 
modeled  by  developing  data  along  four  primary 
dimensions  of  the  force  structure,  viz.,  pay  grade, 
length  of  service,  occupational  specialty,  and  time 
(i.e.,  fiscal  year).  The  quantities  contained  in  the 
force  structure  represent  the  result  of  various  per 
sonnel  flows  such  as  attiition.  retirement,  demotions, 
nonieenlistment.  and  promotions.  These  and  other 
variables  were  selected  because  of  such  consideiations 
as  homogeneity  and  stability  of  behavior,  availability 
of  historical  data,  and  sensitivity  to  policy  control. 
FAST  has  two  features  that  lepresent  significant 
improvements  ovei  other  manpowei  models:  (1)  The 
user  can  directly  control  certain  aspects  of  the  models 
internal  computations,  and  (2)  the  model  can  con 
strain  both  its  actions  and  the  actions  of  the  user  in  a 
manner  similar  to  the  way  in  which  the  real  world 
system  is  constrained 

The  data  processing  system  that  supports  the 
FAST  model  was  developed  over  a number  of  years  in 
response  to  short  term  needs  In  FY  77,  a maiot 
effort  was  undertaken  to  integrate  the  various  aspects 
of  the  FAST  data  processing  system  and  to  provide 


system  documentation.  All  progiams  and  piogiam 
interfaces  were  examined  and  reprogramming  was 
carried  out  as  necessaiy  A scenano  has  been  de 
veloped  tor  verification  and  validation  of  the  FAST 
model  by  (1)  forecasting  a recent  year  of  history  and 
comparing  the  forecasted  results  with  actual  data  and 
12)  performing  a multi  year  forecast  in  which  the 
distiibution  of  force  structure  parameters  can  be 
analyzed. 

Utilization  AT ech  oology  Base  Advance 

The  Bureau  of  Naval  Personnel  has  been  utilizing 
the  FAST  model  since  1974.  The  Chief  of  Naval 
Operations  also  uses  FAST  for  manpowei  pro 
gramming  during  the  Planning.  Programming,  and 
Budgeting  System  (PPBS)  cycle.  Among  the  many 
types  of  personnel  planning  issues  for  which  the 
model  can  be  utilized  ate  the  following. 

• Prediction  of  Petty  Officer  advancement  te- 
sources  by  pay  grade  and  rating  have  been 
made  and  compared  favorably  with  the  FY  77 
actual  results  of  those  taking  advancement 
in  rating  tests. 

• A methodology  was  developed  to  apply  pol 
icy  constraints  on  the  length  of  service  dis 
tribution  of  advancements.  The  method  allows 
for  the  definition  of  promotion  zones  by  pay 
grade  with  upper  and  lower  limits. 

• New  methods  for  the  estimation  of  demo 
tions,  incorporating  length  of  service  con 
straints.  were  implemented 

• A new  method  was  developed  for  computing 
the  distiibution  of  advancements  employ  mg 
minimum  time-in  service  policy  constiaints. 

Pay  off /Potential 

The  new  FAST  model  is  expected  to  he  fully 
implemented  by  FY  78.  Future  plans  and  milestones 
call  for 

a Implementation  of  a new  method  foi  dis 
tnbuting  advancements  using  minimum  time 
in  service  policy  constraints 

a Design  and  implementation  of  an  advance 
ment  optimization  model  to  evaluate  long 
term  effects  of  alternative  advancement 
strategies 

a Implementation  of  new  methods  for  estimat 
mg  prior  service  gains  by  rating,  pay  grade, 
anrf  length  of  service 

• New  strategies  for  the  allocation  of  recruits 
arid  non-designate  apprentices  to  ratings  in 
coordination  with  "A"  school  planning  data 
and  future  requirements  foi  petty  officers. 
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CONFERENCE  ON  FIRST  TERM  ATTRITION 


Need/Ob|ectives 

Attrition  is  a very  costly  problem.  It  drives  up  the 
demand  loi  recruits,  increases  training  costs,  art 
versely  affects  military  readiness,  and  it  may  have 
long  lasting  effects  on  the  individuals  who  drop  out 
When  attrition  throughout  the  Department  of  De 
tense  reached  a new  high  in  1976,  the  Office  of  Naval 
Reseaich  was  asked  to  assume  responsibility  for  a 
conference  to  address  the  problem  of  enlisted  attri 
tion  The  objective  of  the  conference  was  to  assemble 
information  on  attrition  of  first  term  enlisted  per 
sonnel  from  the  Armed  Forces,  to  identify  issues  that 
can  be  addressed  by  R&D,  and  to  put  them  in 
priority  order  for  their  possible  contributions  to 
manpower  planning.  Funding  comes  from  Program 
Element  No  62763N 

Approach  and  Results 

The  confeience  brought  together  research  and 
development  and  operational  people  from  all  the 
services.  In  addition,  papers  were  commissioned  by 
the  contractor  from  researcheis  nominated  by  a 
steering  committee.  Evening  workshops  and  round- 
table sessions,  structured  to  give  a cross  service  mix  of 
participants  and  speakers,  produced  a number  of 
policy  and  research  recommendations. 

Utilization/Technology  Base  Advance 

The  papers  and  related  discussions  of  the  con- 
ference placed  a new  emphasis  on  the  organizational 
or  structural  factors  (as  opposed  to  the  characteristics 


id  individuals)  that  appeal  to  iiillurncr  alKitinii 
They  pointed  out,  for  example,  that  the  quality  of 
low  level  management  ( i.e. . supeivision  by  petty 
officers)  is  an  important  factor.  They  stated  a need 
for  changes  in  recruiting  practices,  particularly  those 
which  lead  recruits  to  have  unrealistic  expectations 
about  service  life.  In  addition,  they  recommended 
new  data  bases  to  enable  the  services  to  maintain 
more  up-to-date  understanding  of  attrition.  Certain 
specific  jobs  were  shown  to  have  disproportionately 
high  attrition  rates,  suggesting  that  the  demands  of 
some  occupations  could  be  redistributed.  A major 
area  of  uncertainty  was  the  economics  of  attri- 
tion: What  is  an  "optimum"  level  of  attrition?  How 
much  will  remediation  cost,  and  what  is  the  likeli- 
hood that  specific  policy  changes  will  reduce  attri- 
tion? 


Payoff/Potential 

The  Office  of  the  Secretary  of  Defense  (OSD) 
asked  each  of  the  services  to  report  on  policies  that 
were  modified  or  new  research  that  was  undertaken 
as  a result  of  this  conference.  Both  the  Navy  and 
Marine  Corps  have  initiated  research  stemming  from 
the  conference  recommendations. 

The  knowledge  assembled  by  the  conference 
about  the  behavior  of  young  people  in  relation  to 
employing  organizations  has  possible  wide  applica- 
bility to  non-military  institutions  both  in  and  out  of 
government. 
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CONFERENCE/SURVEY  ON  COST  BENEFITS  OF  RECREATION 


Need/Otopectives 

In  recent  years.  Navy  comptrollers  and  congres 
sional  personnel  have  been  concerned  about  the 
continued  high  cost  ot  supporting  Navy  tecreation 
programs  ($100  million  in  FY  741  in  the  face  of 
significantly  higher  salaries  instituted  as  a result  of 
the  all-volunteer  force.  The  Office  of  Naval  Research 
(ONR)  was  asked  by  the  Assistant  Chief  of  Naval 
Personnel  (Personnel  Affairs)  to  examine  recreational 
cost  benefits.  An  inquiry  by  the  Smithsonian  Insti 
tution  (under  contract  to  ONR)  determined  that 
relatively  little  was  known  in  either  military  or 
civilian  sectors.  Consequently,  a conference  was 
organized  to  bring  together  civilian  experts  and  Navy 
recreational  specialists,  and  later,  a survey  of  enlisted 
personnel  was  conducted.  The  objective  was  to 
assemble  and  assess  the  benefits  of  Navy  recreation 
programs  in  relation  to  their  costs  and  to  determine 
researchable  issues  that  would  contribute  to  knowl 
edge  about  recreational  benefits.  Funding  comes  from 
Program  Element  No  62763N. 


Approach  and  Results 

The  conference  included  presentations  from  aca- 
demic institutions,  from  Navy  personnel,  and  from 
other  experts.  A technical  report  of  the  proceedings 
was  prepared  including  abstracts  of  all  presentations, 
recommendations  for  research,  and  recommended 
policy  actions.  The  subsequent  survey  sampled 
11,000  personnel  at  16  shore  bases  throughout  the 
United  States. 

The  findings  of  the  conference  and  survey 
covered  the  following  areas: 

• Limitations  of  conventional  cost-benefit  ap- 
proaches to  assessing  recreation  and  some 
alternatives,  e.g.,  the  application  of  economic 
techniques  for  estimating  what  individuals 
would  be  willing  to  pay  for  recreation 

• Some  sociological  perspectives  on  leisure  prac- 
tices and  how  they  are  changing,  e.g.,  expecta- 
tions of  greater  diversity 


• Issues  in  Navy  recreation  about  which  little  is 
known,  e.g.,  client-user  characteristics  and 
needs 

• Innovative  steps  to  test  alternative  lecreation 
policies,  e.g.,  the  use  of  "token  economies"  as 
a way  ot  measuring  demand 

• Cost-avoidance  methods  for  use  in  evaluating 
and  reshaping  the  Navy  recreation  program 

• A policy  option  for  "pay  as-you-play." 

Utilization/Technology  Bate  Advance 

The  Assistant  Chief  of  Naval  Operations  for 
Personnel  Affairs  was  able  to  utilize  the  results  of 
these  protects  to  identify  areas  in  the  recreation 
program  which  personnel  were  willing  to  pay  for. 
This  resulted  in  the  new  "recreational  self-suffi- 
ciency” policy  which  literally  precluded  the  program 
from  going  "bankrupt"  while  maintaining  the  morale 
benefits. 

Findings  concerned  with  the  "perceived  dollar 
value"  of  recreation  programs  to  Navy  personnel  were 
also  determined  and  used  to  evaluate  the  contribution 
of  recreation  to  reenlistment  decisions. 

Payoff  I Potential 

The  data  from  the  recreation  conference  and 
survey  study  can  be  used  bv  researchers  and  policy 
makers  concerned  with  attrition,  recruiting,  morale, 
and  motivation.  While  it  is  difficult  to  present  simple 
cost-benefit  statements,  the  order  of  magnitude  of 
dollars  involved  gives  some  idea  of  the  value  of  the 
recreational  program.  Consider,  for  example,  the 
following: 

• The  budget  for  recreational  programs  was 
$100  M in  FY  74. 

• The  survey  revealed  a perceived  out-of-pocket 
saving  of  $350  pier  pierson;  Navy-wide  this 
represents  approximately  $180  M per  year. 

• If  recreation  were  eliminated  as  a free  benefit, 
the  study  revealed  that  a pay  increase  of  $485 
pier  person  per  year  would  be  necessary  to 
offset  this;  Navy-wide  this  represents  approxi- 
mately $230  M pier  year. 


20 


f 


HUMAN  FACTORS  IN  WEAPON  SYSTEMS 

• V/STOL  Human  Factors  Planning 

• Design  of  an  Integrated  Bridge  System 

• Shipboard  Facilities  Maintenance 

• Software  Design  Specifications  for’an  Interactive  Medical  Diagnosis  System 

• Color  Coding  of  Cockpit  Displays 

• Landing  Signal  Officer  (LSO)  Display  System 

• Sensor/Display  Quality  for  Target  Acquisition 

• Human  Factors  Engineering  Technology  for  Voice  Interactive  Systems  (VIS) 

• Navy  Technical  Information  Presentation  System  (NTIPS) 

• Documentation  of  Ejection  Procedures 

• Computer  Assisted  Methods  for  Human  Factors  Engineering  Design  and  Evaluation 

• Human  Factors  Engineering  Technology  for  Test  and  Evaluation  of  Systems 


V/STOL  HUMAN  FACTORS  PLANNING 


Neerl/Ob)ectiv« 

The  Navy  has  a strong  interest  in  V/STOL  aircraft 
because  of  the  operational  flexibility  inherent  in  the 
vehicle  concept.  The  piloting  factors  required  in  the 
design  and  operation  of  such  aircraft  are  crucial  due 
to  the  unique  type  of  flying  involved.  Furthermore, 
accident  rate  experience  with  V/STOLs  to  date 
(Figure  1)  shows  two  disconcerting  trends.  First,  the 
current  V/STOL  accident  rate  is  increasing,  which  is 
contrary  to  the  typical  experience  when  introducing 
new  aircraft,  and  secondly,  "pilot  factor"  as  a 
contributing  cause  seems  alarmingly  high.  With  re- 
spect to  this  last  point,  the  data  shown  in  Figure  1 
represent  21  accidents,  16  of  which  occurred  in  the 
V/STOL  flight  regime  (i.e.,  conversion  flight,  landing, 
or  take-off).  Of  these  16,  11  had  "pilot  factor"  as  a 
contributing  cause.  The  Naval  Air  Development  Cen- 
ter (NADC),  therefore,  initiated  a program  to  provide 
human  factors  support  early  in  the  design  of  V/STOL 
aircraft. 


1971  1973  1973  1974  1976  1976  1977 

FISCAL  YEAR 


Figure  1.  Accident  Rate  for  AV-8A  V/STOL  Aircraft. 

The  Naval  Weapons  Center  (NWC)  was  tasked  to 
synthesize  past  experience  with  fixed-wing  V/STOL 
aircraft.  The  resulting  documentation  was  to  be  used 
in  planning  human  factors  support  of  Navy  V/STOL 
programs.  Funding  comes  from  Program  Element 
No.  63701 N. 

Approach  and  Results 

A review  and  synthesis  of  the  literature  pertaining 
to  piloting  factors  in  fixed-wing  V/STOL  design  was 


conducted.  Special  emphasis  was  placed  on  con 
trol/display  system  requirements.  This  effort  resulted 
in  two  documents  for  use  primarily  by  human  factors 
personnel. 

The  first  document  summarizes  current  knowl 
edge  and  lessons  learned  from  past  experience  with 
fixed-wing  V/STOL  aircraft.  The  review  indicates  that 
the  central  problem  in  past  designs  has  been  excessive 
pilot  work  load.  The  results  also  show  that  display 
technology  improvements  alone  cannot  solve  the 
piloting  problems.  The  document  provides  a data  base 
organized  by  specific  aircraft  as  well  as  by  mission- 
and  vehicle-related  factors  unique  to  tt.e  V/STOL 
concept. 

The  second  document  provides  introductory 
material  on  the  aerodynamics,  propulsion,  and  flight 
control  technology  for  V/STOL  aircraft.  This  report 
is  intended  to  be  a "primer"  to  provide  background 
material  on  V/STOL  technology  and  operations. 

Utilization/Technology  Base  Advance 

The  documents  resulting  from  this  project  rep 
resent  both  a contribution  to  the  technology  base  and 
a job  performance  aid  for  human  factors  personnel 
engaged  in  the  design  of  V/STOL  aircraft.  The 
documents  are  used  to  define  the  human  factors  work 
which  must  be  done,  to  identify  crucial  areas  and 
systems  in  the  program  (e.g.,  the  aircraft's  stability 
augmentation  system),  and  to  provide  general  guide- 
lines for  human  factors  engineering.  The  V/STOL 
technical  base  program  has  been  restructured  to  take 
these  findings  into  account. 

The  principal  user  at  this  time  is  the  Naval  Air 
Development  Center.  About  250  copies  of  the  report 
have  been  distributed  to  all  three  services  and  a 
number  of  industrial  organizations. 

Payoff /Potential 

This  small  project  has  the  potential  to  (1)  imme- 
diately provide  a basis  for  incorporating  human 
factors  engineering  into  the  early  stages  of  V/STOL 
design  and  (2)  ultimately  contribute  to  the  reduction 
of  "pilot  factor"  accidents. 
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PRECEDING  fjtOS  hi.ANy 


DESIGN  OF  AN  INTEGRATED  BRIDGE  SYSTEM 


t1 


I 


Need/Objectives 

The  design  of  the  bridge  of  Navy  surface  ships  has 
not  changed  significantly  since  World  War  II.  Func 
tions  such  as  navigation  and  collision  avoidance  re 
quire  bridge  watch  standing  personnel  to  have  a con 
tinuoos.  up-to-the-minute  picture  of  the  potentially 
dense  environment  around  them,  sometimes  under 
rapidly  changing  circumstances.  Furthermore,  rising 
manpower  costs  and  diminishing  manpower  resources 
lend  additional  weight  to  the  need  for  more  effective 
bridge  operations. 

In  1972,  a Shipboard  Manning  and  Automation 
Project  Office  was  established  at  the  David  W.  Taylor 
Naval  Ship  Research  and  Development  Center  and 
charged  with  finding  ways  to  reduce  bridge  watch 
standing  on  Navy  ships.  The  first  effort  was  a pilot 
program  conducted  to  investigate  the  feasibility  of 
bridge  manning  reductions  on  existing  ships.  The  in- 
tegrated bridge  system  (IBS)  project  was  then  estab- 
lished to  address  long-range  needs. 

The  objective  of  the  integrated  bridge  system  was 
to  demonstrate  a potential  for  reducing  surface  ship 
bridge  watch  manning  requirements  while  maintain- 
ing or  improving  operational  effectiveness.  Funding 
comes  from  Program  Element  No.  62757N. 

Approach  and  Results 

The  pilot  program  examines  the  feasibility  of  re- 
duced bridge  manning  through  integration  of  existing 


equipment  and  introduction  of  automation  into  a 
centralized  work  station  for  bridge  watch  standers. 
Based  on  the  results  from  17  ships  participating  in  the 
pilot  program,  it  was  demonstrated  that  some  imme 
diate  leduction  in  brickie  watch  standing  could  tv 
achieved. 

The  approach  of  the  Integrated  Bridge  System 
Project  was  based  on  the  premise  that  improvements 
in  bridge  functions  could  be  achieved  largely  through 
integration  of  state-of-the-art  equipment  with  selec- 
tive automation  and  more  effective  procedures.  These 
functions  included  navigation,  maneuvering,  commu- 
nications, surveillance,  administration,  and  safety. 
The  goal  of  reduced  manning  with  the  same  or  in- 
creased effectiveness  was  achieved  through  centraliza- 
tion, consolidation,  and  automation  of  new  and  exist- 
ing bridge  equipment  along  with  a redistribution  of 
watch-standing  tasks  and  associated  bridge  proce- 
dures. 

The  experimental  system  consists  of  two  major 
consoles  and  peripheral  bridge  remote  equipment. 
The  equipment  was  laid  out  to  maximize  effective 
bridge  operation  within  the  constraints  of  the  existing 
structure.  Figure  1 shows  the  general  arrangement  of 
the  equipment  in  the  pilot  house.  The  major  compo- 
nent of  the  IBS,  which  governs  maneuvering  and 
navigation  capability,  utilizes  the  standard  Navy 
computer,  the  UYK-20,  to  automate  many  of  the 
time-consuming  and  error-prone  manual  functions  in 
current  operations. 


I, 


The  system  was  installed  and  tested  onboard  the 
USS  MCCANDLESS  (FF  1179)  during  January  July 
1977.  Results  of  the  at-sea  evaluation  showed  con 
dusively  that  bridge  manning  requirements  could  be 
■ educed  significantly  while  simultaneously  improving 
the  bridge  effectiveness.  Specific  reductions  in  watch 
standing  depend  upon  the  particular  teadiness  condr 
lions  under  which  the  ship  is  operating.  Table  1 
provides  some  of  the  results  from  the  study  aboard 
the  USS  MCCANDLESS. 

Table  1 

Reductions  in  the  Number  of  Watch  Standing 
Personnel  when  Utilizing  the  Integrated  Bridge  System 
under  Various  Readiness  Conditions 


Condition 

Number 

Readiness 

Description 

Conventional 

Bridge 

Manning 

IBS 

Manning 

1 IAS) 

General  Quarters 
(Anti-Submarine 
Warfare) 

21 

17 

III 

Wartime  Cruising 

16 

7 

IV 

Peacetime  Cruising 
(Formation) 

14 

7 

Utilization/Technology  Base  Advance 

The  technology  resulting  from  this  project  may 
be  applied  to  both  new  construction  and  existing 
surface  ships.  At  present,  collision  avoidance  and 
navigation  systems  for  surface-effect  ships,  hydro 
foils,  and  the  Coast  Guard  WMEC  270  class  ships  are 
being  developed  based  on  the  technology  from  this 
project. 


Pay  off  /Potential 

If  an  integrated  bridge  system  concept  were 
implemented  on  new  Navy  ships,  the  decrease  in 
manpower  required  on  the  bridge  during  moat  opera 
tional  conditions  would  free  personnel  for  other 
tasks.  The  effect  would  be  increased  cleanliness, 
readiness,  and  longer  life  for  the  ship. 

Developmental  costs,  as  well  as  actual  installation 
costs,  are  considered  minimal.  They  are  outweighed 
by  the  expected  advantages:  increased  manpower 
effectiveness,  reduction  in  confusion,  and  the  occur- 
rence of  fewer  collision  situations. 
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SHIPBOARD  FACILITIES  MAINTENANCE 


Need/Ob|ectivei 

Hit-  Navy  has  a continuing  need  to  maintain  the 
cleanliness.  appearance,  diKl  nidleiidl  condition  ut  its 
ships  Histoncdlly.  tdcilities  maintenance  (house 
keeping,  cleaning  dnd  pieseivdtion)  hdi  lequned  a 
signdicdnt  expenditure  of  man  hums,  at  sea  and  in 
poit.  and  has  theiehy  i educes!  availahility  ot  ship 
boat d peisonnel  loi  other  duties  and  technical  at! 
vancement  With  the  advent  ot  the  all  volunteer 
force  stiuctuie  and  the  consequences  ot  new  design 
trends,  tewei  people  are  available  to  perform  the 
lequuesi  facilities  maintenance  (FM).  This,  coupled 
with  long  term  problems  ol  inadequate  facilities 
maintenance  equipment,  matenals,  training,  ami 
management,  has  resulted  in  wasted  inanpowei  and 
material  and  premature  detenoratiun  of  ships'  con 
ditions. 

the  David  W Tayloi  Naval  Ship  Reseaich  ami 
Development  Centei,  Annapolis  (DTNSRDC/A), 
assisted  by  the  Navy  Peisonnel  Research  and  De 
velopment  Centei  (NPRDCI  and  suppoiled  by 
opeiational  ships  in  the  Fleet,  has  umleitaken  a 
protect  to  develop  new  facilities  maintenance  con 
cepts  which  will  leduce  the  numbei  of  peisonnel 
and  man  houis  lequned  foi  this  continuing  ship 
boaid  activity  The  specific  objectives  of  the  pioject 
aie  to  develop  a system  ol  equipment,  pioceduies, 
manpower  otganization,  ti anting,  and  management 
techniques  ami  to  test  them  in  actual  shipboaid 
enviionments  Funding  comes  from  Piogiam 
Element  No  62757N 


Approach  and  Results 

The  protect  was  initiated  in  FY  74  with  a sys 
tematic  analysis  of  FM  tasks  which  led  to  the 
identification  of  more  effective  ( t ) oigani/ation, 
management,  ami  technical  information;  (2)  equip 
ment.  matenals,  am!  environment,  and  13)  training. 
Dunng  FY  76,  the  new  system  was  successfully 
demonstrated  ahoaid  the  USS  TRIPPE  (DE  10/6) 
Results  from  this  feasibility  demonstiation  included: 

• FM  man  horns  weie  i educed  by  20  to  40% 

• Spaces  maintained  weie  geneially  luted  as 
satislactmy  or  trettoi  with  respect  to  overall 
appeal  ance  and  cleanliness. 

• Job  skill  ami  knowledge  of  FM  peisonnel 
incieased. 

• The  overall  FM  piogiam  received  geneially 
favoialile  ratings 


Utilitation/T ech  oology  Base  Advance 

Fins  pioiect  is  nut  yet  completed  Detailed  le 
suits  will  be  available  in  1979/1980  Howevei.  as  « 
result  of  the  feasibility  demonstiation  the  following 
pielimmaiy  utilization  is  undeiway 

• The  Guided  Missile  Ship  Acquisition  Pto 
giam  Office  (PMS  399)  requested  and 
received  suppoit  in  developing  an  innovative 
FM  system  tailored  to  the  FFG  7 class  ship 
Cuuently,  the  USS  OLIVER  HAZARD 
PERRY  has  some  of  the  innovations  in- 
stalled 

• The  Commander.  Naval  Logistics  Command, 
Pacific  Fleet  (COMNAVLOGPAC).  and  the 
Naval  Development  Training  Center/Fleet 
Maintenance  Assistance  Group.  Pacific 
( D ATCFMAGPAC),  also  requested  and 
leceived  suppoit  from  the  project  office  in 
developing  and  testing  the  innovations  tor 
the  DD  963  class  ships 

a Othei  potential  usei  organizations  in  both 
the  Atlantic  ami  Pacific  F leets  amt  the  Naval 
Ship  Engineering  Center  (NAVSEC)  have 
been  continually  bnefed  ami  made  aware  of 
the  reseaich  findings 

Payoff /Potential 

Table  1 piesents  estimates  which  have  been 
made  for  a Ingate  (FF  1052  class)  and  a nuclear 
powered  cat  net  (CVAN)  in  teims  ot  manpowei  sav 
mgs  from  FM  innovations. 


Table  1 

Estimated  Manpower  Savings 
Through  FM  Innovation 


P»i  Ship 

Pat  Ship 

FF  1062  Class 

CVAN 

Current  FM 

Weekly  Work 
load  in  Man 

Hour* 

1387 

10.910 

Estimated  % 
Savings 

2030% 

2030% 

Estimated  Man 

Hour  Saving*/ 

Week 

277  416 

2.182-3.273 

Estimated  Nunv 
bar  ot  Men 

69 

51  76 

Estimated  Life 

cycle  Dollar 
Savings 

S1.35M  S2.02M 

$1 1.5M  -$1 7.1  M 
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Other  potential  payolf  areas  include: 

• Cleanliness  and  improvement  of  shipboard 
spaces  - Quality  of  all  FM  work  will  be  im 
proved. 

• Satisfaction  - It  is  estimated  that  ships' 
officers  will  express  positive  opinions  con 
cerning  the  effects  of  FM  innovation  in 
all  areas  including  training,  habitability, 
increased  efficiency,  and  manpower  utili/a 
lion. 


• Materials  expenditures  - Targeted  expendi 
tures  for  paint,  FM  materials,  etc  will  be 
decreased. 

• Skill/Knowledge  - It  is  estimated  that  FM 
workers  will  demonstrate  significantly  im 
proved  capability  to  understand  and  peilorm 
FM. 

• Habitability  - Ship  spaces  will  lx-  considered 
more  habitable  by  the  people  who  live  and 
work  in  them. 


SOFTWARE  DESIGN  SPECIFICATIONS 
FOR  AN  INTERACTIVE  MEDICAL  DIAGNOSIS  SYSTEM 


Need/Objectives 

Medical  diagnosis  and  fault  location  in  electronics 
equipment  both  require  a "troubleshooting"  ap 
proach.  In  either  case,  the  cause  of  a dysfunction  is 
determined  by  measuring  the  system's  reaction  to 
prescribed  and  controlled  stimuli.  Each  step  in  the 
diagnostic  sequence  depends  on  results  from  previous 
steps  in  the  sequence. 

The  objective  of  this  project  is  to  design  a 
software  package  to  enable  a computer  to  construct 
the  logical  sequence  necessary  to  diagnose  a medical 
problem.  Funding  comes  from  Program  Element 
No.  62766N. 

Approach  and  Results 

There  are  distinct  requirements  for  diagnostic 
expertise:  ( 1 > technical  ability  to  obtain  the  necessary 
measurements  and  (2)  knowledge  of  all  the  condi- 
tional measurement  sequences  so  that  optimum  data 
are  collected  at  each  step.  If  the  fundamental  abilities 
and  knowledge  required  in  a particular  specialty  can 
be  built  into  a computer  system,  then  the  demands 
on  the  diagnostician  may  be  reduced. 

In  FY  76,  the  Navy  Personnel  Research  and 
Development  Center  (NPRDC)  devised  system  design 
principles  for  a software  package  to  aid  in  medical 
diagnosis.  The  field  of  physical  medicine  and  rehabili- 
tation was  used  to  examine  the  feasibility  of  the 
concept:  A physician  would  construct  a logic  tree  of 
diagnostic  sequences  so  that  a properly  trained 
technician  using  a computer  could  perform  a sound 
diagnostic  sequence.  The  software  was  debugged  and 
verified  through  utilization  of  historical  medical 
records. 


Utilization/Technology  Base  Advance 

NPRDC,  in  collaboration  with  the  Naval  Regional 
Medical  Center  (NRMC),  San  Diego,  devised  a soft 
ware  package  that  would  conduct  the  appropriate 
diagnostic  sequence  to  reveal  neural  lesions  involving 
the  upper  limbs.  This  package  was  implemented  or  a 
computer  system  by  NRMC  and  has  the  following 
characteristics: 

• It  requires  minimal  knowledge  of  computers 
on  the  part  of  the  user. 

• It  allows  for  the  construction  of  arbitrary 
logic  trees. 

• The  user  may  override  the  logic  tree  or  enter 
unsolicited  data. 

• The  system  is  fast,  efficient,  and  inexpensive 
to  run. 

The  present  system  has  also  been  used  as  a 
rudimentary  training  device,  although  it  was  not 
designed  for  that  purpose. 


Payoff /Potential 

Potential  benefits  are  not  limited  to  the  medical 
profession.  Payoff  could  be  expected  in  any  highly 
technical  field  in  which  fault  diagnosis  must  be 
accomplished  by  a complex  logical  procedure.  Such 
payoff  would  come  in  the  following  ways: 

• Reduction  in  the  number  of  skilled  profes- 
sionals required 

• Increase  in  the  quantity  of  fault  location 
work  accomplished  per  unit  of  time 

• Increase  in  the  quality  of  fault  location  work. 
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COLO'*  CODING  OF  COCKPIT  DISPLAYS 


Need/Obtectives 

The  increasing  sophistication  of  airborne  weapons 
and  aircraft  avionics  has  greatly  increased  the  require 
ments  to  display  information  to  the  aircrew  All  of 
the  military  services  have  RDT&E  progiams  for 
integrated  cockpit  instrumentation  The  Navy  is 
pursuing  its  Advanced  Integiated  Display  System 
(AIDS):  the  Air  Foice  program  is  the  Digital  Avionics 
Instrumentation  System,  and  the  Army  is  developing 
fiberoptic  displays  and  solid  state  electionics  to 
teplace  conventional  helicopter  engine  dials  and 
gauges  The  development  of  airborne  computers  and 
color  cathode  ray  tubes  (CRT's)  now  makes  it 
feasible  to  provide  color  coded  displays  to  the  air 
crew.  However,  the  usefulness  of  color  has  not  been 
established  The  question  of  real  performance  advan 
tages  in  using  coloi  rather  than  other  types  of  coding 
must  be  lesearched  and  answered  before  design 
commitments  are  made 

The  specific  obiective  of  this  project  at  the  Naval 
Weapons  Center  was  to  evaluate  the  advantages  and 
disadvantages  of  color  coding  in  aircraft  cockpit 
displays  (e  g.,  CRT  displays).  The  project  was  re 
quested  by  the  Naval  Air  Systems  Command 
(NAVAIR)  (Air  34 OF  and  D)  and  coordinated  with 
the  Naval  Air  Development  Center  (NADC).  Funding 
comes  from  Program  Element  No.  63763N. 

Approach  and  Results 

A series  of  laboratory  experiments  was  designed 
to  investigate  the  effectiveness  of  color  coding  for 
potential  cockpit  application.  The  experiments  inves 
tigated:  (1)the  effect  of  color  on  monitoring  mal- 
function indications  while  engaged  in  a target  detec 
tion  task  and  (2)  the  relative  effectiveness  of  black 
and  white,  single  color,  or  two-color  coded  displays. 

Videotape  recorders,  monitors,  and  response 
recorders  were  set  up  in  an  equipment  room.  The 
subject  had  a display/response  unit  with  as  many  as 
three  TV  monitors  and  buttons  for  making  target 
response  or  malfunction  response  inputs.  Addition- 
ally, the  subject’s  TV  monitors  could  be  reviewed 
under  conditions  of  red  and  white  illumination. 

Experiments  were  conducted  in  which  both  target 
detection  and  malfunction  detection  times  were 
recorded  Performance  with  the  black  and  white 
displays  was  used  as  a standard  of  comparison  for 
performance  with  color  and  color-coded  displays. 
Percent  performance  change  was  calculated.  A variety 
of  findings  resulted  and  will  help  to  determine  where 
specific  applications  of  color  are  warranted  In 


general,  the  experimental  results  indicated  that  there 
is  a slight  advantage  to  color -coded  displays  over 
black  and  white  displays  (Figures  1 and  2). 
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Utihzation/Technology  Bate  Advance 

The  inloimatiun  tiom  this  protect  has  been  used 
as  the  I us  is  tor  the  decision  to  use  monochrome 
CHT’s  in  the  lust  Advanced  Integrated  Display 
System  The  state  ot  the  art  Tor  monochromatic  dis 
plays  is  well  advanced,  at  least  lot  CRT  lepresenta 
tions,  and  requires  only  moderate  developmental 
effort 

Information  obtained  from  the  literature  review 
and  the  continuing  experiments  is  being  maintained 
as  a resource  for  future  R&D  Technical  reports  and 
briefings  have  been  used  to  disseminate  information 


horn  this  project,  and  NADC  human  factois  engim-eis 
have  made  wiitten  design  lecommendations  to  NADI* 
design  engineers  based  on  this  pioiect 

Payoff /Potential 

The  use  of  a monochrome  CRT  lathei  than  a 
multicolor  display  in  the  fust  AIDS  system  lepiesents 
a cost  saving  ot  about  $8,000  per  display  It  coloi 
coding  were  not  used,  a saving  ot  perhaps  $15,000 
per  aircraft  would  be  realized.  The  human  payoff  is  in 
the  improved  crew  performance  with  the  selected  use 
of  color . 


I 
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LANDING  SIGNAL  OFFICER  (LSO)  DISPLAY  SYSTEM 


Need/Otoiectives 

Canter  based  aircraft  land  at  speeds  up  to 
140  knots,  day  and  night,  and  sometimes  in  low 
visibility  conditions  including  rain  and  fog.  The 
Landing  Signal  Officer  (LSO)  coordinates  with  the 
approaching  pilot,  provides  guiding  signals,  and  de 
erdes  whether  the  airciaft  can  land  safely.  In  mini- 
mum weather  conditions,  the  LSO  may  have  only 
2 or  3 seconds  to  make  this  decision.  Because  of  the 
complexity  and  critical  nature  of  this  task,  the 
training  period  to  qualify  LSO‘s  for  one  aircraft  type 
is  about  14  months.  Each  year  there  are  accidents, 
some  fatal  and  extremely  costly,  that  might  have 
been  avoided  had  the  l SO  had  an  information  display 
system  that  fully  met  his  information  needs.  The 
purpose  of  the  project,  therefore,  was  to  determine 
the  information  needed  by  the  LSO  and  to  develop  a 
display  system  to  provide  it.  Funding  comes  from 
Program  Element  No.  61153N. 

Approach  and  Results 

The  original  research  into  this  problem  was 
sponsored  by  the  Office  of  Naval  Research  (Aero 
nautics  Programs)  and  subsequently  supported  by  the 
Naval  Air  Systems  Command.  A detailed  analysis  was 
performed  on  the  information  required  by  the  LSO 
to  perform  his  tasks,  with  particular  focus  on  those 
areas  where  his  judgment  might  be  aided  by  the 
display  of  critical  aircraft  performance  parameters 
(e  g.,  line  up,  glide  slope,  air  speed,  sink  rate,  range) 
The  information  requirements  were  incorporated  into 
an  innovative,  see  through  display  system  which 


provides  the  information  while  still  peimittmg  the 
LSO  to  monitor  the  airciaft  visually  during  the  entue 
approach. 

Utilization/Technology  Base  Advance 

The  Navy  has  built  a prototype  unit  of  the 
display  system  and  conducted  opeiational  evaluations 
ashore  at  the  Naval  Air  Test  Center  and  at  sea  on  the 
USS  RANGER.  The  results  of  the  evaluation  in 
dicated  overwhelming  approval  ot  the  new  display 
system  Some  45  LSO's  participated  in  the  evaluation 
and  indicated  that  the  new  display  will  improve  both 
the  safety  and  efficiency  of  earlier  landing  opera 
tions. 

The  system  is  going  into  production  and  will  be 
implemented  on  all  carriers  within  the  next  2 yeai 
period.  Similar  studies  have  been  performed  at  other 
carrier  work  stations  with  similar  results. 

Payoff  /Potential 

An  aii  plane  crash  aboard  a carriei  can  damage  oi 
destroy  the  aircraft  plus  other  planes  and  equipment 
and  temporarily  stop  operations  from  that  carrier. 
Cost  savings  from  utilization  of  the  LSO  display  are 
difficult  to  project;  however,  the  cost  of  carrier  based 
aircraft  alone  can  run  between  $6  and  $16  million. 
While  it  is  not  possible  to  attribute  any  given  number 
of  aircraft  saved  to  the  LSO  display,  officers  aboard 
carriers  feel  certain  that  use  of  this  display  will  lead 
to  safer  landing  operations,  thereby  reducing  cas 
ualties  and  damage  costs  and  improving  carrier 
operational  efficiency. 
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SENSOR/DISPLAY  QUALITY  FOR  TARGET  ACQUISITION 


< 


1 


N**d/Obf«ctiv«i 

A number  of  airborne  weapon  systems  aie  being 
rleveloped  which  regime  operator  performance  wilti 
television  and  forward  looking  infrared  (FUR>  sys 
terns  For  example,  the  A 6E.  A 7E.  and  the  OV  10D 
aircraft  have  FUR  systems  under  development  De 
sign  questions  concerning  the  opeiator  s performance, 
specification  of  system  parameters,  and  methods  of 
system  evaluation  have  been  presented  by  engtneeis 
to  human  factors  fiersonnel  at  the  Naval  Weapons 
Center  (NWC) 

The  obfective  of  tins  particular  project  was  to 
relate  engineering  descriptors  of  sensor  and  display 
parameters  to  human  operator  performance.  Applica 
tion  of  the  results  should  improve  target  acquisition 
ranges  Funding  comes  from  Program  Element 
No  62763N 

Approach  and  Results 

A number  of  laboratory  experiments  were  con 
ducted  at  the  Naval  Weapons  Center  to  measure  the 
effects  of  image  or  picture  quality  from  a TV  or 
FUR  sensor  in  opeiator  performance  at  detection, 
recognition,  and  identification  of  targets.  Small, 
square  targets  were  placed  against  a plain  background, 
viewed  by  a TV  camera,  and  displayed  to  the  subject 
on  a TV  monitor.  Sobfects  were  required  to  perform 
various  tasks  related  to  target  acquisition  while  the 
quality  of  the  images  was  manipulated  by  vaiymg  the 
sire  and  the  number  of  i aster  lines  makinq  up  the 
•mage. 

A numbei  ol  variables  including  (II  such  opeiatot 
factors  as  training,  expei  lence,  and  biiefmgs  (2)  tai 
get  factors,  such  as  si/e,  shape  contrast,  and  sur 
roundings;  (3)  atmospheric  conditions,  such  as  sun 
angle  and  atmnsphenc  attenuation  and  (4)  the 
imaging  system  characteustics,  such  as  frequency 
response  and  spectral  sensitivity,  can  affect  taiget 
acquisition  jrerformance  However  when  these  van 
ables  are  not  limiting  (i.e  . do  not  degrade  perform 
ance),  scan  line  number  and  site  can  be  used  to 
predict  operator  performance,  as  shown  in  Table  1 

The  data  from  this  protect  have  insulted  in  some 
design  changes,  and  specifications  lor  some  engineer 
mg  parameters  have  been  established 

Previous  research  at  NWC.  the  Air  Force  Aero 
space  Medical  Research  Laboratories,  and  the  Army 
Night  Vision  Labot  atory  provided  the  foundation  for 
this  proiect. 


Table  1 

Scan  Line  Requnements 
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Utilization /Technology  Bate  Advance 

The  A 7 program  office  used  the  data  from  this 
project  to  direct  the  A 7E  FUR  Head  Up  Display 
development  Contractors  both  in  the  U S.  and 
England  were  monitored  and  directed  in  the  applica 
tion  of  these  data  Acceptance  tests  have  also  been 
conducted 

The  F 18  human  factors  effort  used  the  infoima 
tion  to  aid  the  contractor  in  display  specifications  toi 
the  aircraft  The  infrared  engineering  community  at 
NWC  has  reviewed  and  evaluated  mathematical 
models  of  FUR  performance  in  light  of  these  results; 
these  models  are  used  for  FLIR  design  and  to 
generate  FLIR  design  specifications. 

Technical  reports  documenting  all  work  have 
heen  ptepaied  and  issued.  An  initial  distribution  of 
250  copies  of  the  leports  was  made,  in  addition, 
35  inquests  have  come  from  other  potential  users. 
Human  factors  personnel  have  also  participated  in 
design  meetings  and  as  members  of  design  teams  and 
have  provided  expertise  as  requested. 

Payoff /Potential 

Applications  from  this  project  to  system  design 
(eg.,  A 7 FLIR  and  F-18FLIR  and  displays!  will 
lesult  in  improved  target  acquisition  ranges  This,  in 
turn,  will  result  in  a higher  probability  of  weapon 
launch  and  reduced  aircraft  vulnerability.  As  an 
example,  if  improved  display  image  quality  reduces 
operating  time  by  4 seconds,  the  probability  of  a 


30 


successful  target  attack  is  taisetf  front  20  to  25  (an 
increase  of  25%  in  the  numlrei  of  targets  that  can  be 
attacked)  These  results  have  come  from  a joint 
services  weapon  deliveiy  study 

It  is  important  to  iHrte  that  many  organisations, 
principally  in  the  aeiospace  industry,  have  requested 


copies  of  the  lepoit  born  this  protect,  and  the  wmk 
has  served  to  structure  continuing  lesearch  in  in 
dustiy.  In  addition,  repoits  have  been  sent  to  othei 
countries  under  data  exchange  agreements.  Tire  data 
resulting  from  this  research  would  also  (mi  useful  in 
television  communications  work 


HUMAN  FACTORS  ENGINEERING  TECHNOLOGY 
FOR  VOICE  INTERACTIVE  SYSTEMS  (VIS) 


Need/Ob|ectiv*s 

Modern  aircraft  requite  the  pilot  to  observe  more 
information  than  he  can  understand  and  operate 
mote  controls  than  he  can  easily  handle  He  is  also 
required  to  do  this  in  increasingly  crowded  cockpits 
One  way  of  reducing  visual  workload  (and  errors 
caused  by  overload)  is  to  provide  the  pilot  with  the 
ability  to  input  data  or  interrogate  the  system  by 
voice  and  to  teceive  auditory  information  about 
system  status 

The  obiective  of  this  protect  is  to  develop  and 
demonstrate  an  alternative  mode  of  operator  com 
munication  termed  a Voice  Interactive  System  (VIS). 
Funding  comes  from  Program  Element  No  62757N. 

Approach  and  Results 

The  Naval  Air  Development  Center  (NADC)  is 
conducting  this  protect.  Current  efforts  are  attempt- 
ing to  determine  applications  of  Voice  Interactive 
Systems  (VIS)  in  crew  station  design,  performance 
measurement,  and  training  simulation  systems.  The 
approach  provided  for: 

• Systematic  examination  of  existing  complex 
controls  and  displays  in  order  to  determine 
which  components  could  most  effectively  be 
augmented  by  the  application  of  VIS 

• Determination  of  the  ability  of  VIS  to  mom 
tor.  measure,  and  score  verbal  communica 
tions  among  crewmembers  and  other  per 
sonnet  (i  e . ground  -ontrolleis.  other  air 
craft,  etc.)  and,  mote  significantly,  identifica 
tion  of  the  crew  actions  (i  e . commands  used 
to  activate  control  settings,  such  as  radio 
frequencies  or  data  entries)  which  are 
initiated  ot  terminated  through  speech  com 
mends 

• Identification  ot  airborne  crewmembers  for 
whom  the  appltcation  of  VIS  tor  training 
should  yield  more  adequate  information  con 


corning  a trainee's  piogress,  provide  tiaineo 
performance  feedback,  and  reduce  naming 
costs  by  simulating  one  or  more  persons  in 
multiple  pei son  training  situations 

The  above  efforts  involve  troth  identification  of 
areas  tor  the  application  of  VIS  and  consideration  ot 
the  technical  feasibility  ot  a given  application  in 
terms  of  the  present  state-of  the  art  capability  of 
voice  technology. 


Utifuatron/Tech oology  Baae  Advance 

NADC  work  focused  on  the  development  of 
processors  for  comprehension  of  word  meanings  and 
on  identification  of  the  moat  valuable  potential 
airborne  applications  of  VIS.  Available  documenta 
tion  now  provides  systematic  examinations  ot  the 
existing  control  and  display  complexes  and  evalua- 
tions of  possible  VIS  applications.  Crew  actions,  such 
as  commands  to  activate  control  settings,  which  are 
or  could  be  initiated  and  terminated  thiough  voice 
commands  have  also  been  identified.  The  output  of 
these  application  studies  has  been  used  to  develop  the 
conceptual  framework  necessary  for  a detailed  im 
plementation  program. 

A voice  recognition  and  systhesis  system  is 
currently  being  adapted  for  the  Navy’s  Advanced 
Integrated  Display  System  (AIDS)  simulator  to  allow 
inclusion  of  VIS  capability  in  AIDS  engineering 
development 

Payoff  /Potential 

It  is  anticipated  that  techniques  developed  and 
proved  by  the  project  will  have  wide  application  in 
future  naval  systems.  The  technology,  although  being 
developed  for  an  airborne  application,  can  be  used  to 
unburden  operators  of  surface  and  subsurface  systems 
as  well. 
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NAVY  TECHNICAL  INFORMATION  PRESENTATION  SYSTEM  (NTIPS) 


N**d/Ob|«cti*«* 

Senous  deficiencies  exist  in  Technical  In 
toimation  ITU  accompanying  hardware  systems  in 
the  Fleet  Consequently.  material  readiness  is  'educed 
through  quo i maintenance,  ti dining,  logistic  suppoit. 
and  operations  Typical  deficiencies  die 

• Inciedsmg  complexity  dm!  volume  ol  II 
coupled  with  deci  easing  leading  dtwl  com  pie 
hension  dlsility  ol  new  Navy  personnel 

e Delays  in  piovidiny  initial  documentation  ami 
in  updating  documents  to  retlect  configure 
turn  changes  and  con  act  enois 

e Inconsistencies  between  technical  documenta 
tion  toi  tidimng  and  technical  documentation 
lot  logistics 

• An  excessive  number  ol  enois  ami  othei 
inadequacies 

• Escalating  costs  ol  developing  and  distributing 
Tl. 

As  a tesult  ol  these  deliciencies,  there  has  been  a 
giowiny  dissatisfaction  and  underuse  of  technical 
inloimation  among  Fleet  operating,  maintenance,  and 
training  personnel 

To  conect  these  problems,  the  Naval  Ship  Re- 
search and  Development  Centei  (N SR  DC  I at 
Carder ock  was  tasked  to  develop  the  Navy  Technical 
Inloimation  Piesentation  System  (NTIPS).  When 
completes!  and  implemented,  this  will  be  a Navy-wide 
system  lot  the  generation,  distribution,  and  control 
ol  Tl  loi  use  in  system  operation,  maintenance, 
naming,  ansi  logistic  suppoit.  Funding  comes  from 
F*rogiam  Element  No.  62757N 

Approach  and  Results 

A systems  approach  is  lie  mg  takers  to  develop  a 
single  process  (sir  the  complete  control  ol  systems  le 
latest  Tl  The  needs  ol  all  user  communities  are  being 
consiileresl  concurrently  Human  lactois  engineering 
technology  am!  other  supporting  technologies  such  as 
logistics,  miciogiaphics.  automatic  data  processing, 
ami  publishing  aie  being  applied  and  developed  The 
program  is  being  cainesl  out  in  three  phases 


I System  and  Feasibility  Tiadeoft  Analysis 

II  Critical  Element  Testing  and  Detailesi 
NT  IP  System  Design 

III  Prototype  Test  and  Implementation 
Recommemiations. 


Utilixation/Technology  Hate  Advance 

Phase  I has  been  completed  with  lour  maioi 
accomplishments  First,  actual  problems  experienced 
with  Tl  in  the  Fleet,  the  various  system  commands, 
and  the  training  command  were  identified  Secondly, 
the  cut  lent  state  ol  the  art  in  Tl  generation,  distnbu 
tion,  and  control  was  assessed,  together  with  cuirent 
procedures  in  the  Department  of  Defense  and  else 
wheie.  Thirdly,  evolving  human  factors  and  support 
mg  technologies  in  Tl  were  also  assessed  and  synthe 
sired 

• A concept  for  effecting  a user  data  match  for 
Tl  has  been  defines!.  This  concept  involves  the 
application  o!  human  engineering  principles 
to  the  design,  development,  and  use  ol  T I 
The  key  is  a methodology  to  achieve  an 
eltective  balance  among  the  various  combma 
trons  of  personnel  characteristics.  |ob  tasks, 
environmental  conditions,  training  considera 
tions.  maintenance  philosophy,  and  appro 
pnate  Tl  toimats  and  media  The  concept  also 
involves  establishment  ol  specifications  for 
i eadability /comprehensibility 

• Cunent  and  emeigmg  technologies  have  been 
assessed  by  type  of  medium  and  by  applica 
bility  to  specific  NTIPS  functions,  such  as 
data  acquisition,  content  geneiation.  replica 
tion,  and  disti ibution.  Included  aie  micio 
forms  (microfiche  and  miciotilm),  video  disc 
techniques,  holographic  media,  advanced 
automated  (digitized)  ptocet  nes  foi  input, 
stoiaqe.  output,  and  tiansmission  of  text  and 
giaphics,  as  well  as  tequiied  instrumentation 
foi  display,  demand  output,  and  interactive 
manipulation  of  data  Hybrid  (eg  , audio 
visual)  systems  weie  also  investigated 

Finally,  a preliminary  NTIP  system  concept  was 
developed  (Figure  1)  and  will  seive  as  the  basis  foi 
the  detailed  NTIPS  design  effoit  in  Phase  II 
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Figure  1.  NTIPS  Prttlminary  System  Concept.  A/femaf/ve  ///. 


Payoff  /Potential 

When  implemented,  NTIPS  will  assist  the  Fleet  in 
several  ways.  From  the  perspective  of  operators  and 
maintenance  technicians,  it  will  represent  an  improve 
ment  in: 

a Technical  information  quality  and  consis- 
tency — The  user-data  match  process  will  help 
insure  that  the  new  Tl  will  be  written  at  a 
level  to  match  the  ability  of  the  user  and  will 
be  presented  in  a format  and  medium  suited 
to  his  job  tasks  and  working  environment. 

• Accuracy  of  the  Tl  — Improved  quality  assur- 
ance procedures  and  speedier  resolution  of 
errors  and  configuration  mismatches  between 
hardware  and  the  Tl  will  result  from  a better 
system  for  configuration  control  and  remedial 
action  and  update  procedures. 

• Homogeneity  of  the  basic  technical  content 
presented  to  the  user  - first  in  his  service 
school  ashore,  later  in  his  shipboard  training, 


and  finally  in  his  working  assignment  (opeiat 
ing  or  maintenance).  NTIPS  will  provide 
coordinated  Tl  for  the  training,  operating, 
and  maintenance  communities. 

• Availability  of  Tl  - More  efficient  and 
standardized  methods  of  generation,  replica 
tion,  distribution,  feedback,  and  update  are 
inherent  in  NTIPS. 

• Opportunity  to  apply  cost  savings  resulting 
from  NTIPS  to  improve  Fleet  readiness  in 
other  areas  - The  Navy  currently  maintains  a 
$5  billion  inventory  in  Tl  and  spends  hun 
dreds  of  millions  of  dollars  in  these  areas 
annually.  Savings  of  no  more  than  10%  could 
represent  $50-5100  million  annually  in  new 
Tl  alone.  These  savings  could  be  diverted  to 
other  areas  where  funds  are  badly  needed  In 
addition,  time  saved  aboard  ship  by  elimi 
nating  inaccurate  or  inefficient  Tl  can 
represent  a significant  contribution  to  read< 
ness. 
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DOCUMENTATION  OF  EJECTION  PROCEDURES 


N**d/Objectivas 

Fifteen  percent  of  "the  crewmembers  who  must 
abandon  disabled  |et  aitciafl  do  not  survive  This 
Utility  nte  has  remained  constant  ovei  the  yens 
despite  large  wale  improvements  in  election  hard 
ware  The  ineffective  hardware  improvement  caused 
Navy  officials  to  hypothesice  that  poor  aircrew  pier 
tormance  could  be  a contributing  factor  to  this 
costly  loss  of  life.  Accordingly,  the  Navy  initiated 
lesearch  to  investigate  this  possibility  The  ob|ec 
tives  of  the  research  protect  were  as  follows: 

• Determine  whether  faulty  aucrew  per 
formance  could  be  contributing  to  the  poor 
ejection  survival  rates. 

• Determine  whether  information  pmblems  in 
the  pilots'  handbooks  could  be  linked  to 
poor  aircrew  performance 

• Determine  whether  state  of  the  art  in 
infoimation  presentation  has  the  potential  to 
reduce  the  handbook  pioblems  and  thereby 
improve  crew  performance 

• Test  an  improved  version  of  the  ejection 
relevant  information  to  determine  the  levels 
of  aircrew  improvement  which  could  be  ex 
pected. 

This  project  was  supported  jointly  by  the  Naval 
Ship  Research  and  Development  Center,  Carderock 
and  the  Naval  An  Systems  Command  (Code  531). 
Funding  comes  from  Program  Element  No.  63727N. 

Approach  and  Results 

Obiective  1 

Analysis  of  ejection  accidents  indicated  that  air 
crew  errors  occurred  in  all  phases  of  the  ejection 
and  survival  process.  The  pre  egress  phase  (vijr..  ejec 
tion  decision)  and  the  survival  and  rescue  phase 
were  most  prone  to  error,  and  the  pre  egress  ettois 
were  particularly  costly.  A separate  Naval  Safety 
Center  study  showed  that,  on  the  average, 
about  40%  of  the  election  fatalities  were  caused  by 
a delay  in  initiating  election  These  data  cast  suspi 
cion  on  both  the  ejection  decision  and  the  ejection 
procedures  (vu.  slow  procedure  performance  could 
delay  ejection) 


Obiective  2 

Serious  faults  were  found  in  the  handbook  m 
loimalion  piovided  to  guide  the  election  decision 
The  most  notable  fault  was  that  the  infoimation 
was  so  complex  that  aucrew  personnel  could  not 
memori/e  it  foi  use  in  the  an.  Similai.  though  not 
quite  so  serious,  faults  were  found  in  the  procedural 
portions  of  the  handbook. 

Objective  3 

Human  factois.  job  aid,  and  turning  literature 
provided  numerous  state  of  the  art  presentation 
techniques  capable  of  correcting  the  deficiencies 
found  in  the  handbooks.  These  techniques  were 
used  to  piepare  sample  presentations  which  pilots 
and  crewmembers  then  compared  with  conventional 
presentations.  The  improved  versions  were  preferred 
by  an  overwhelming  margin,  as  indicated  by  Fig 
ure  1. 

1.  Do  you  prvtvi  rh*  (Tatailad  or  timplitivd  vvrnon  ol  tha 
Diva  Angle  chair’ 

4%  V Derailed 
96%  W Simplified 

2 Do  the  lulet  ol  rhumb  mcieaae  the  usability  ot  the  Dive 
Angle  chart’ 

82%  M Vat 
18%  1C  No 

3 Are  the  rules  ol  rhumb"  a reasonable  approach  to  clarity 
ing  the  question  ot  whan  to  elect’ 

93%  » Yet 

7%  SC  No 

Figure  7.  Sample  Preference  Reaponaet. 

Objective  4 

State  of  the  ai t techniques  were  applied  to  im 
prove  the  ejection  guidance  in  the  handbook  for  a 
training  jet.  A control  group  of  student  pilots  and 
naval  flight  officers  studied  the  conventional  instruc 
tions  while  an  experimenta  group  studied  the  im 
proved  instructions.  Foui  tests  were  used  to  assess 
the  effect  of  the  study  on  initial  learning  and  reten 
tion.  The  experimental  group  outscored  the  contiol 
group  on  all  tour  tests.  Regarding  the  all-important 
ejection  decision,  subjects  who  studied  with  the 
new,  improved  material  outscored  the  control  group 
by  more  than  three  to  one  (65%  correct  vs.  20% 
correct).  Figure  2 graphically  indicates  these  differ 
ences. 
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Utilization/Technology  Base  Advance 

This  lesearch  shows  that  documentation  is  an 
inexpensive  means  of  fostering  learning  and  recall. 
This  is  a significant  finding  regarding  an  airman's 
performance  of  time-critical  (no  time  to  refer  to  a 
book  or  chart),  hazardous  (errors  can  cause  death  or 
injury)  actions. 

Payoff  /Potential 

Naval  Air  Systems  Command  may  redo  the  ejec 
lion  relevant  information  in  the  handbooks  of  key 
aircraft,  monitoring  the  ejection  accident  statistics 
to  discern  any  effect  on  "delayed  ejections"  and 
fatalities.  Considering  the  fact  that  individual  pilot 
replacement  costs  are  now  being  estimated  at  more 
than  one  million  dollars,  the  potential  payoff  is 
indeed  significant. 
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COMPUTER  ASSISTED  METHODS 

FOR  HUMAN  FACTORS  ENGINEERING  DESIGN  AND  EVALUATION 


Need/Objectives 

Current  aviation  systems  are  experiencing  signif- 
icant operational  and  safety  deficiencies.  Many  of 
these  deficiencies  are  attributable  to  inadequate 
consideration  of  operator  and  maintainer  capabilities 
during  system  design.  Problems,  such  as  excessive 
operator  work  load,  inappropriate  automation  and 
crew  utilization,  and  confusing  displays  and  warning 
systems,  can  degrade  system  performance  and  in- 
crease accident  risk.  The  Naval  Safety  Center  esti- 
mates that  such  design  deficiencies  result  in  30  to  40 
aircraft  losses  annually  at  a cost  of  $115  million. 
Even  where  human  engineering  support  has  been 
available  for  emerging  systems,  as  in  the  LAMPS  and 
F-18  programs,  human  engineering  has  not  been 
optimal  because  of  lack  of  techniques  to  provide 
timely  and  objective  inputs  to  design  decision  makers. 
The  timeliness,  accuracy,  and  objectivity  of  human 
factors  engineering  inputs  to  design  decision  makers 
can  be  improved,  and  this  is  the  general  goal  of  this 
project. 

The  specific  objectives  of  the  project  are  to 
develop  computer  models  and  techniques  which 
extend  and  improve  the  capabilities  of  human  factors 
engineers  to  provide  effective  support  for  developing 
weapon  systems.  This  technology  can  result  in: 

• Increased  mission  effectiveness  through  im- 
proved function  allocation  and  automation, 
optimal  crew  station  design,  and  verified 
capability  of  operators  to  perform  mission 
tasks 

• Reduction  in  life-cycle  costs  arising  from  late 
engineering  changes  necessitated  by  early  de- 
sign errors 

• Increased  impact  of  human  factors  rec- 
ommendations through  specific  focus  on  con- 
ceptual and  early  design  phase  problems 

• Fuller  exploitation  of  human  factors  data  by 
training  personnel 

• Predictions  of  expected  system  performance 
as  a function  of  varying  operator  skill  and 
training  levels. 

Funding  comes  from  Program  Element  No. 
62763/63701 N. 

Approach  and  Results 

The  computer  assisted  methods  (CAM)  project  is 
a collection  of  related  computer  models  and  tech- 
niques, in  various  stages  of  development,  which 
permit  the  rapid  and  timely  application  of  human 


factors  data  and  methods  to  new  system  develop- 
ment. The  project  is  assigned  to  the  Naval  Air 
Development  Center  (NADC)  with  suppoit  from 
several  other  Navy  organizations  The  model  develop 
ment  effort  was  initiated  in  FY  71  and  has  continued 
until  the  present.  The  principal  models  and  the  areas 
they  address  are  as  follows: 

a Interactive  design  support  models  (IDSM). 
Currently  there  are  four  models  in  this  group: 

— panel  space  allocation  for  controls  and 
displays  (CUBITS) 

— development  of  standardized  and  mean- 
ingful  labeling  and  abbreviation 
(ABBREV) 

— analysis  of  operator/maintainer  per- 
formance when  handling  equipment 
(Equipment  Handling) 

— evaluation  ot  operator  capability  to  reach 
all  displays  and  controls;  crew  station 
assessment  of  reach  (CAR). 

• Simulation  of  the  human  operativ  (HOS). 
This  model  provides  the  human  factors 
analyst  with  the  capability  to  simulate  the 
performance  of  an  operator  following  a de- 
fined scenario.  The  model  will  also  simulate 
the  performance  variability  found  both  within 
and  between  trained  operators. 

• Computer  function  allocation  and  evaluation 
system  (CAFES).  This  area  actually  consists 
of  four  computerized  models  and  a data 
management  system  (DMS)  for  the  transfer  of 
intermediate  products  between  models.  The 
four  CAFES  models  are: 

- function  allocation  model  (FAM)  - iden- 
tifies the  most  effective  allocation  of 
system  functions  among  operator/hard- 
ware/software components 

- workload  assessment  model 
(WAM)  - identifies  potential  operator 
overload,  the  location  of  the  problem,  and 
the  probable  cause 

- computer  aided  design  (CAD)  - provides 
capability  for  graphical  representation  of 
proposed  panel  layouts,  relocation  of 
panel  components,  rescaling  of  panels, 
and  production  of  panel  drawings 

- crew  station  geometry  evaluator 
(CGE)  — determines  the  compatibility  of 
proposed  crew  station  designs  with 
anthropometric  dimensions  of  operators 
and  identifies  control  and  display  inter- 
ference problems. 


LEGEND 
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Payoff  /Potential 

The  requirement  for  timely,  accurate,  and  objec 
live  human  factors  engineering  data  and  techniques  in 
weapon  system  design  is  increasing.  This  requirement 
can  only  be  met  by  the  use  of  high  speed  computer 
capability  to  reduce  the  time  delay  and  to  relieve  the 
tedium  and  potential  inaccuracy  inherent  in  manual 
approaches.  Sophisticated  computer  models,  algo- 
rithms, and  automated  data  handling  methods  can 
organize  and  evaluate  the  massive  task  structures  and 
background  data  generated  during  modern  system 
design.  The  techniques  produced  and  evaluated  by 
this  project  can  be  utilized  during  the  design  and 
evaluation  of  all  future  Navy  aircraft,  surface,  and 
subsurface  crew  stations.  Furthermore,  the  tech- 
niques, since  they  are  generic  and  not  Navy-unique, 
can  and  have  been  utilized  by  the  Army,  Air  Force, 


S SCHEDULED 
P * PROPOSED 


NASA,  and  industry.  CAR.  for  example,  has  been 
converted  for  in-house  use  by  companies  such  as 
Northrop  and  IBM  and  is  being  modified  by  NASA 
for  space  shuttle  design. 


An  example  of  the  kind  of  impact  which  can  be 
realized  from  early  application  of  human  faciota 
engineering  technology  is  available  from  the  F-18 
aircraft  design.  The  crew  station  assessment  of  reach 
(CAR)  model  was  applied  to  the  initial  design 
drawings.  The  analysis  revealed  that  only  20%  of  the 
aviator  population  would  be  able  to  ■J«e  all  critical 
controls.  The  seat,  stick,  and  emergency  controls 
were  relocated  and  redesigned  using  CAR  rec- 
ommendations. The  percentage  of  aviators  now  ac- 
commodated increased  to  80%. 
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HUMAN  FACTORS  ENGINEERING  TECHNOLOGY 
FOR  TEST  AND  EVALUATION  OF  SYSTEMS 


Need/Ob|ecttvat 

the  test  dmj  evaluation  (T&E)  ot  naval  weapon 
systems  includes  an  evaluation  of  the  effectiveness  of 
the  hiimen  ds  d component  in  the  totdl  system  This 
research  protect  ws>  initiated  hy  the  Parr  tic  Missile 
lest  Cental  ds  d result  ot  deficiencies  uncoveied  in 
the  human  factor  evaluation  process  try  the  Navy, 
mcludi.g  the  lack  of  adequate  design  cntena  and 
insufficient  T81E  methodology  Although  the  human 
factors  requirements  during  system  development  are 
mandated  hy  Department  ot  Defense  directives,  a 
formal,  structured  appmach  is  necessary  to  cootdi 
nate  and  integrate  activities  dunng  the  entiie  T&E 
cycle 

The  objective  ot  the  protect  was  to  develop  an 
operationally  01  tented  approach  to  insure  the  success 
ful  inclusion  of  human  factors  engineering  (HFE) 
principles  and  procedures  during  the  test  and  evalua 
tion  ot  naval  weapon  systems.  Funding  comes  tfrim 
Program  Element  No.  63 JOIN. 

Approach  and  Ftesulti 

The  research  methods  employed  in  this  project 
ranged  from  simple  direct  observation  to  computet 
modeling  of  evaluation  systems.  The  ma|or  emphasis, 
however,  was  on  the  employment  of  field  research 
methods. 

There  were  three  maiot  task  aieas  within  the 
HFE  T&E .protect.  They  were. 

• Methodology 

• Communication 

• Implementation 

These  tasks  were  undertaken  to  provide  systema 
tic  approaches  to  the  evaluation,  documentation,  and 
implementation  of  human  factors  requirements, 
assumptions,  and  data  throughout  the  evolution  ot 
naval  systems. 

Each  task  area  addresses  a unique  aspect  of  Navy 
HFE  T&E.  The  methodology  T&E  tasks  provide 
procedures,  methods,  and  techniques  for  evaluating 


Navy  systems.  The  communications  task  will  piovide 
pioceduial  documentation  loi  conducting  and  lepoit 
mg  on  human  tactois  evaluation  as  well  as  minima 
turn,  education  and  tiauung  id  opeiation.il  anil 
manaqenal  personnel  in  human  tactois  and  system 
development  The  implementation  task  sets  requite 
merits  foi  evaluation  reiHirt  contents  and  specified 
tions  for  assunng  inclusion  ot  test  results  in  future 
design  efforts. 

Utilitation/Technology  Base  Advance 

Seveial  products  ot  the  progiam  have  been 
operationally  integrated  into  system  design.  They 
include: 

• Human  Factors  Test  and  Evaluation  Manual 
(HFTEMANI.  HFTEMAN  has  been  used  in 
the  tactical  electronic  reconnaissance  process 
ing  and  evaluation  program  (TERPES)  to  set 
guidelines  for  conducting  auditory  testing  on 
the  TE  RPES  system. 

• Feedback  Loop  Actron  Generation  System 
(FLAG).  This  is  a computer  tiling  system 
which  maintains  recoids  ot  human  engineer 
ing  deficiencies.  FLAG  assists  in  locating  the 
analysis  and  design  deficiencies  associated 
with  types  of  air ci aft.  missions,  displays,  and 
conti ols.  Systematically  analyzing  the  data 
can  piovide  a means  to  avoid  past  design 
er  tors. 

These  methodologies  have  been  applied  on  the  FIR, 
S 3A.  and  P 30  weapon  systems. 

Payoff /Potential 

The  HFTEMAN  has  been  distributed  to  Army, 
Navy,  and  Ail  Foice  commands  engaged  in  opera 
tional  test  amt  evaluation  In  addition.  McDonnell- 
Douglas  and  Noithrop  aie  using  it  in  developing  the 
F 18.  The  FLAG  system  has  also  been  used  to  tiack 
deficiencies  on  the  F 14  and  EA  6.  Any  organization 
that  must  conduct  field  appiaisals  on  simple  or 
complex  systems  should  be  able  to  employ  the 
conceptual  model  and  specific  methods,  techniques, 
and  procedures  developed  in  this  research  effort. 
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EDUCATION  AND  TRAINING  TECHNOLOGY 

• Feasibility  of  Various  Shipboard  Instructional  Delivery  Systems 
a Personnel  Readiness  Training 

• The  Navy's  Computer  Managed  Instruction  System 

• Instructional  Systems  Development  and  Effectiveness  Evaluation 

• Individualized  Instruction  in  Mess  Management  Training 

• Modeling  the  Costs  of  Specialized  Training 


I 


FEASIBILITY  OF  VARIOUS  SHIPBOARD  INSTRUCTIONAL  DELIVERY  SYSTEMS 


Need/Ob|ectives 

Increasing  manpower  costs,  combined  with  in- 
creasing preference  for”  one-tour  enlistments,  have 
resulted  in  renewed  concern  for  economizing  the 
Navy's  first  tour  training  costs.  This  concern  has 
stimulated  studies  to  examine  the  feasibility  of 
shifting  some  portion  of  technical  training  to  the 
shipboard  environment.  Such  a shift  could  require  a 
substantial  increase  in  the  number  of  documents 
aboard  ships. 

At  this  time,  approximately  864,000,000  pages  of 
printed  on-board  training  materials  aie  published 
annually  by  the  Chief  ol  Naval  Education  and 
Training.  Included  are  Personal  Qualification  Stand- 
ards. Rale  Training  Manuals,  Correspondence 
Courses,  and  Advancement  in  Rate  Examinations.  In 
addition,  contractor  provided  equipment  manuals  and 
factory  training  materials  support  training  on  board 
ship.  Any  proposal  to  significantly  increase  the 
volume  of  printed  documents  to  be  stored,  used,  and 
maintained  there  will  meet  serious  Pleet  resistance. 

The  Navy's  Training  Analysis  and  Evaluation 
Group  (TAEG)  initiated  a study  to  evaluate  the 
feasibility  of  producing  innovative  forms  of  paper, 
microfiche,  and  electronic  media  for  on-board  train- 
ing programs.  Alternative  state-of  -the-art  instructional 
delivery  systems  are  being  researched  and  evaluated 
to  determine  cost-effective  systems.  Funding  comes 
from  Program  Element  Nos.  62656N  and  62757N. 

Approach  and  Results 

A series  of  related  projects  has  been  undertaken 
to  develop  a final  design  concept.  At  the  conclusion 
of  these  studies,  recommendations  will  be  made  to 
the  Chief  of  Naval  Education  and  Training  concerning 
which  media  to  use  for  on-board  training  in  the 
1980's.  Two  such  projects  have  been  completed. 

Five  alternatives  to  the  current  publishing  system 
were  evaluated.  These  included  the  use  of  word 
processors,  text  editors,  electronic  composers,  type- 
setteis,  and  digitized  graphics.  An  automated  publish- 
ing system  has  been  recommended  which  offers  the 
following  savings:  (1)  $1.5  million  annually  in  print- 
ing costs  through  the  use  of  typesetting  and 
(21  $200  thousand  annually  in  the  labor  costs  of  text 
editing  through  the  use  of  multiterminal  text  editor 
systems. 


The  second  project  assessed  the  technical  feasi- 
bility. training  effectiveness,  economic  efficiency,  and 
user  acceptance  of  microfiche.  Principal  findings 
were: 

• Navy  recruits  could  use,  with  minimum  in- 
struction, any  of  the  microfiche  readers 
tested. 

• The  Grid  map/pointer  microfiche  indexing 
system  was  found  to  be  the  most  efficient. 

• Sound/microfiche  programs  were  positively 
received  by  both  trainees  and  instructors. 

• There  was  no  significant  difference  belween 
the  performance  of  trainees  using  curricula 
printed  on  paper  and  that  of  trainees  using 
curricula  printed  on  microfiche. 

Utilization/Technology  Base  Advance 

The  findings  of  these  projects  are  being  used, 
along  with  other  information,  to  create  a functional 
specification  for  an  on  board  instructional  delivery 
system.  The  role  of  paper,  microform,  and  elec- 
tronic-based media  will  be  defined.  The  specification 
will  describe  how  on-board  training  materials  will  be 
authored,  produced,  distributed,  used,  and  updated. 
It  will  define  the  role  of  computer  aids  in  each  of 
these  phases,  and  the  cost-effectiveness  of  the  pro- 
posed approach  will  be  compared  with  that  of  other 
options. 

Payoff  /Potential 

Using  the  computer  aided  publishing  system 
proposed  by  TAEG,  annual  savings  of  $1.7  million 
can  be  achieved  in  the  production  of  existing  training 
documents.  Eighty  percent  of  this  effoit  is  in  support 
of  on-board  training. 

Additional  savings  should  result  from  the  im 
plementation  of  other  findings  in  this  series  of 
studies.  As  an  example,  significant  economies  should 
result  from  the  use  of  the  computer  aids  for  authors 
of  instructional  materials.  Preliminary  results  suggest 
a time  saving  of  at  least  10  to  1 in  witting  symbol 
learning  packages,  whm  compared  with  present 
authoring  techniques.  When  an  appropriate  set  of 
author  aids  ‘Ms  been  completed,  this  magnitude  of 
saving  should  also  be  achieved  in  authoring  training 
packages  to  teach  procedures.  If  this  can  be  ar 
complished,  perhaps  one-fourth  of  the  Navy  course 
ware  development  effort  could  be  authored  with 
computer  aids. 
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PRECEDING  PjOK  m.Aisy 


PERSONNEL  READINESS  TRAINING 


Need/Objectives 

In  1972  a team  of  Navy  Management  Repres enta 
lives  was  established  to  identify  current  training  prob 
lems  One  problem  identified  was  that  Fleet  com 
manders  lacked  confidence  in  the  ability  of  some 
shipboard  personnel  to  perform  significant  aspects  of 
their  jobs  The  team  recommended  development  and 
evaluation  of  a personnel  readiness  training  system 
for  use  in  the  Fleet.  The  project  was  performed  by 
the  Navy  Personnel  Research  and  Development  Cen 
ter  (NPRDC). 

The  specific  objective  was  to  develop  a system 
which  would  both  identify  and  correct  significant 
shipboard  personnel  performance  deficiencies.  Per- 
sonnel readiness  could  thereby  be  continually  up- 
graded. Funding  comes  from  Program  Element 
No.  63720N. 

Approach  and  Results 

Critical  job  demands  of  three  Navy  ratings  were 
selected  for  study:  (1)  submarine  Sonar  Technician, 
(2)  submarine  Missile  Technician,  and  (3)  Boiler 
Technician.  The  research  design  required  three  groups 
of  subjects  within  each  specialty:  a control  group,  a 
diagnostic  feedback  group  (this  group  received  feed 
back  concerning  diagnosed  performance  deficiencies), 
and  a diagnostic  feedback  plus  training  group  (this 
group  also  received  self-instructional  remedial  training 
materials).  All  three  groups  in  each  specialty  were 
given  a diagnostic  pretest  and,  after  approximately  5 
months,  the  same  test  was  readministered. 

Pretesting  revealed  substantial  performance  defi- 
ciencies in  some  job  demands  of  all  three  ratings.  In  a 
few  areas,  feedback  alone  provided  some  minimal  per- 
formance improvement,  however,  it  was  not  enough 
to  be  of  any  practical  significance.  Feedback  plus  the 
remedial  training  materials  produced  substantial  per- 
formance improvements  for  the  Sonar  Technicians, 
but  the  Missile  Technicians  and  Boiler  Technicians 
showed  little  evidence  of  improved  performance.  This 
lack  of  improvement  was  later  discovered  to  be  due 
to  failure  to  use  the  assigned  instructional  materials. 

Utilization/Technology  Base  Advance 

Over  300  testing/training  packages  had  been  dis 
tributed  to  the  Fleet  as  of  early  1977.  Both  the  At- 
lantic and  Pacific  submarine  commands  requested  the 
Sonar  Technician  packages  for  nuclear  ballistic  missile 
(SSBN)  and  nuclear  attack  (SSN)  submarines  with  the 
designated  equipment  and,  in  addition,  they  re- 
quested that  similar  packages  be  developed  for  other 
shipboard  equipment.  The  sonar  packages  have  also 
been  distributed  to  several  shore  commands.  The  test 


mg/trainmg  packages  developed  foi  the  Boiler  Tech 
nician  and  the  Missile  Technician  have  likewise  been 
■ equested  and  distributed  to  opciational  and  tiaining 
commands  in  the  Fleet. 

This  project  is  thus  an  excellent  example  of 
people-related  research  which  originated  to  support 
an  operational  need,  was  developed  to  be  used  by 
operational  and  training  commands  in  the  Fleet,  and 
has  been  distributed  and  utilized  by  Fleet  personnel 

Payoff  /Potential 

The  potential  benefits  from  the  Personnel  Readi 
ness  Training  project  are  exemplified  by  the  results 
experienced  by  Sonar  Technicians  in  the  Fleet.  The 
combination  of  diagnostic  testing  and  remedial  train 
ing  materials  yields  significant  improvements  in  criti- 
cal aspects  of  this  Navy  technician's  job.  From  the 
standpoint  of  the  SSBN's  mission,  the  sonar  search 
task  is  the  most  important  of  those  tested.  Results  of 
this  task  were  fairly  typical  of  those  found  on  all 
tasks.  As  shown  in  Figure  1,  the  remedial  training 
group  improved  significantly  on  the  posttest  while 
the  performance  of  the  other  two  groups  remained 
substantially  the  same  from  pretest  to  posttest.  The 
pretest  performance  levels  of  all  three  groups  are 
considered  to  be  inadequate  for  Fleet  performance. 
Improvements  such  as  those  indicated  in  Figure  1 will 
improve  sonar  contact  information  and  will  reduce 
spurious  information  which  can  mask  real  contact 
information  or  be  misinterpreted  as  relating  to  a 
nonexistent  contact. 
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Figun  1.  Pra-  and  Posttatt  Performance 
on  dta  Sonar  Saarcft  Teak 


By  utilizing  the  products  from  this  project, 
selected  job  demands  critical  to  F'eet  readiness  can  be 
continually  monitored  and  upgraded. 
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THE  NAVY'S  COMPUTER  MANAGED  INSTRUCTION  SYSTEM 


Need/Obfectives 

The  general  principle  that  military  training  should 
be  designed  to  train  students  in  the  shortest  period  of 
time  to  specific  performance  objectives  emerged 
dramatically  in  the  early  1970's.  It  became  clear  that 
careful  training  analyses  and  the  employment  of 
effective  training  techniques  would  be  the  endeavor 
of  future  training  developers.  As  a result,  the  Naval 
Technical  Training  Command  (NTTC)  and  the  Navy 
Personnel  Research  and  Development  Center 
(NPRDC)  initiated  a series  of  projects  with  the 
objective  of  establishing  a computer  managed  instruc- 
tional system  designed  to  assist  in  the  development  of 
cost-effective,  time-constrained,  individualized  in- 
struction systems.  Funding  comes  from  Program 
Element  No.  63720N. 

Approach  and  Results 

The  Navy's  Computer  Managed  Instruction  (CMI) 
System  is  basically  a decision-making  technique.  By 
relying  on  a large  data  base,  it  determines  which 
segment  of  instruction  is  appropriate  to  the  student. 
Depending  upon  the  structure  of  the  curriculum,  CMI 
is  also  capable  of  directing  the  student  to  a particular 
segment  of  instruction  at  several  different  levels  of 
difficulty.  It  can  direct  a student  to  repeat  the  entire 
instruction,  repeat  segments  of  it,  or  lead  him  to  a 
different  form  of  presentation. 

The  CMI  system  was  developed  and  evaluated  on 
three  organizational  billets  in  an  A-7E  squadron. 
Graduates  of  the  conventional  training  sequences 


were  compared  with  graduates  ol  the  ex|>etimental 
sequences.  The  evaluation  demonstiated  that  the 
experimental  trainees  required  considerably  less  train 
ing  time  (ranging  from  10%  to  61%)  than  their 
conventionally  trained  counterparts.  Follow-up  of 
these  two  groups  of  trainees  indicated  that  experi- 
mentally trained  personnel  performed  superior  to  or 
as  well  as  conventionally  trained  students.  Some  of 
the  materials  from  all  three  programs  were  also  used 
for  on-the-job  training  in  the  operational  squadron. 

Utilization/Technology  Bate  Advance 

At  present,  six  courses  of  instruction  at  nine 
separate  schools  utilize  the  Navy's  Computer 
Managed  Instruction  System.  These  schools  are  lo- 
cated at  four  separate  major  training  centers.  During 
the  early  part  of  1978,  several  additional  courses,  two 
additional  schools,  and  one  more  major  training 
center  will  be  added  to  the  system.  The  present 
schools  include  nearly  7,000  students,  and  3 years 
from  now,  this  number  will  exceed  13,000  at  24 
separate  schools. 

Payoff  /Potential 

The  concept  of  individually  paced  instruction 
utilized  by  the  Navy's  Computer  Managed  Instruction 
System  has  demonstrated  a reduction  in  training  time 
of  approximately  50%,  and  hence,  a projection  for 
substantial  cost  avoidance.  Furthermore,  the  results 
of  several  evaluations  reveal  that  slightly  higher  test 
scores  were  achieved  on  the  final  examination  by  the 
students  in  this  mode  of  instruction. 
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INSTRUCTIONAL  SYSTEMS  DEVELOPMENT  AND  EFFECTIVENESS  EVALUATION 


Nead/Objectivas 

Historically  the  design  and  development  of  avia 
tion  weapon  system  training  curricula  has  not  been 
standardized  Aircraft  simulators  and  instructional 
programs  were  individually  designed  and  usually  not 
evaluated  after  they  had  been  turned  over  to  the  user 
The  need  for  a well  structured,  systematic  method  of 
determining  training  requirements,  media  selection, 
and  other  aspects  of  curricula  development  has  long 
been  recognized.  In  1974,  the  Deputy  Chief  of  Naval 
Operations  for  An  Warfare  directed  the  Naval  Air 
Systems  Command  to  begin  a formal  aircrew  Instruc 
tional  System  Development  (ISD)  R&D  program.  The 
scope  of  the  program  included  operator  and  main 
tenance  training  for  both  emerging  and  existing 
aviation  weapon  systems. 

The  Human  Factors  Laboratory  of  the  Naval 
Training  Equipment  Center  (NTECI  undertook  the 
project  with  the  following  general  objective: 

• Develop  a comprehensive  instructional  syStem 
design  guide  which  documents  management 
and  technical  procedures  for  the  acquisition 
of  ISD  programs  for  emerging  and  existing 
weapon  systems. 

Funding  comes  from  Program  Element  No.  62757N. 


and  had  ongoing  training  progtams  loi  the  auciews. 
and  the  EA6BandA6F,  which  weie  undergoing 
niaioi  modification  and  mquiicd  essentially  new 
training  programs.  Phase  2 was  concerned  with  the 
development  and  pioduction  ol  the  instiuctional 
mateiials,  piocurcment  of  required  training  equip 
mom,  training  courses  foi  instiuctnrs  and  squadron 
supei visor y personnel,  and  implementation  and  evalu 
ation  of  the  ISD  training  progiam.  The  genet ul 
approach  of  the  pioject  was  to  integrate  state 
of  theart  ISD  technology  and  inter  service  oxpei  lento 
into  an  ISD  framewoik  for  use  by  contractois.  A 
different  contractoi  was  selected  for  each  aircraft  and 
permitted  to  use  his  own  training  development 
techniques  within  the  genet al  ISD  framework.  Addi 
tionally,  to  provide  a basic  program  structure,  each 
contractor  was  required  to  provide  both  a task 
analysis  and  a training  analysis  to  include: 

• The  development  of  measurable  performance 
standards 

• A media  analysis 

• A sequencing  of  instructional  materials 

• An  organization  of  course  content 

• A determination  of  optimal  instructional 
strategy. 


Approach  and  Results 

Instruction  systems  development  is  a process 
which  applies  systems  logic  to  curricula  development 
and  instructional  delivery.  This  process  is  designed  to 
yield  a complete  and  integrated  instructional  program 
that  satisfies  the  training  requirements  for  a weapon 
system  throughout  its  life  cycle.  ISD  evolved  from 
other  approaches  used  by  the  services,  for  example, 
Systems  Approach  to  Training.  However,  the  ISD 
approach  offers  a more  comprehensive  methodology 
to  meet  the  needs  of  all  personnel  involved  in  the 
military  training  process. 

The  project,  as  undertaken  by  NTLC,  is  a 
two  phase  effort.  Phase  1 focused  on  the  analysis  and 
design  of  ISD  aircrew  training  programs  for  each  of 
four  airborne  weapon  systems.  These  aircraft  were 
the  E 2C  and  the  SH  2F,  which  were  fully  operational 


Utilization/Technology  Base  Advance 

The  Phase  1 objective  was  completed  for  all  four 
aircraft  communities.  One  system,  the  SH-2F 
LAMPS,  was  funded  for  Phase  2 and  implemented 
ami  evaluated  in  1977.  The  E-2C  system  is  currently 
in  Phase  2.  Funding  constraints  have  delayed  further 
implementation  for  the  othei  two  aircraft. 

The  ISD  model  developed  for  aucrew  operator 
training  has  been  modified  for  application  to  aviation 
maintenance  training.  A procurement,  based  on  the 
modified  model,  is  undei  way  for  maintenance  train 
ing  on  the  AN/AWG-10A,  F 4 missile  weapon  system. 

Current  and  planned  utilization  of  the  ISD 
process  in  the  naval  aviation  weapon  system  com 
munities  is  shown  in  Figure  1 
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— APPLICATIONS 


INITIAL  ON-GOING  PLANNED 
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Payoff /Potential 

Apiihcalions  of  the  ISO  approach  have  been 
partially  validaturl  and  the  following  benefits  iden 
tilled 

• A potential  25%  increase  in  student  through 
put  rate 

• A potential  40%  reduction  in  acquisition  costs 
as  compared  to  traditional  training  programs 

• A potential  30%  saving  in  life  cycle  support 
costs 


INDIVIDUALIZED  INSTRUCTION 

Need/Objectives 

The  combining  of  several  ratings  into  the  Mess 
Management  Specialist  (MS)  rating  resulted  in  the 
necessity  of  improving  the  existing  "A"  school 
training  course.  The  U.S.  Army  Natick  Laboratory,  in 
conjunction  with  the  Navy  Personnel  Research  and 
Development  Center,  was  asked  to  examine  the 
feasibility  of  improving  the  existing  training  with 
individualized  instruction,  and  to  assess  the  applica- 
bility of  the  resulting  materials  to  shipboard  training 
requirements. 

The  primary  objective  of  the  project  was  to 
demonstrate  the  contribution  of  individualized  in- 
struction to  overall  performance  at  the  Navy's  Mess 
Management  "A"  school.  A secondary  objective  was 
to  provide  training  materials  for  evaluation  by  the 
Navy’s  Food  Management  Teams.  Funding  comes 
from  Army  RDT&E  funds. 

Approach  and  Results 

The  Wardtoom  Service  phase  of  the  MS  "A” 
school  was  designated  by  the  project  sponsors  as  a 
representative  sample  of  the  course.  The  Navy's 
Instructional  Systems  Design  approach  was  used  as  a 
guide  in  analyzing,  developing,  and  evaluating  individ 


a Increased  training  efficiency  due  to  increased 
flexibility  in  student  training  scheduling,  de 
creased  aircraft  training  flight  time,  reduced 
oveiall  training  time,  and  more  standardi/a 
lion 

a Integration  ol  the  instructor,  students,  and 
training  devices  into  a total  training  system 
able  to  meet  stated  naming  ohiertives  mote 
cost-effectively 

a Operational  Fleet  air  personnel  have  stated 
that  ISD  program  giaduates  reaching  the  Fleet 
are  as  effective  as  those  with  two  years  of 
experience. 


MESS  MANAGEMENT  TRAINING 

uali/ed  instructional  materials.  The  materials  were 
presented  to  a class  entering  the  Wardroom  onase  of 
the  MS  "A"  school  course.  Comparisons  were  made 
between  this  class  and  othei  classes  that  had  received 
conventional  methods  of  instruction. 

The  data  indicated  that  an  individualized  course 
foimat  was  technically  feasible  for  the  Wardroom 
phase  of  the  MS  class  "A"  school.  It  was  concluded 
that  the  training  time  required  for  the  MS  "A"  school 
course  could  be  reduced,  and  improvements  in 
student  proficiency  could  be  achieved  through  the 
use  of  individualized  instructional  techniques. 

Utilization/Technology  Base  Advance 

Instructors  in  the  Mess  Management  Specialist. 
Class  "A"  School,  Naval  Training  Center,  San  Diego, 
are  presently  using  the  materials  developed  by  this 
project  in  the  Wardroom  Service  phase  of  the  course. 

Payoff /Potential 

It  is  believed  that  il  the  individualized  course 
format  utilized  in  the  study  were  implemented  for 
the  entire  course,  a reduction  in  training  time  and 
personnel  and  improved  student  per  Jormance  would 
result. 
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MODELING  THE  COSTS  OF  SPECIALIZED  TRAINING 


Need/Objectives 

Specialized  training  in  the  Navy  consumes  more 
than  half  of  the  total 'training  budget.  However,  no 
current  methodology  exists  which  accurately  sizes  the 
specialized  training  budget  or  estimates  the  marginal 
cost  of  training.  In  response  to  this  need,  the  Center 
for  Naval  Analyses  was  tasked  by  the  Bureau  of  Naval 
Personnel  to  develop  a resource  model  for  specialized 
training  costs. 

Approach  and  Results 

Data  analysis  techniques  and  computer  modeling 
were  used  to  define  and  develop  a costing  model.  At 
present,  the  model  reasonably  determines  the  re- 
quired funding  for  specialized  training.  Seventy  per- 
cent of  the  total  manpower  costs  can  be  accurately 
determined.  The  remaining  30%  can  be  estimated  by 


protection  of  past  costs.  Funding  comes  from  Studies 
and  Analysis  funds. 

Utilization/Technology  Base  Advance 
The  ultimate  product  of  this  project  will  be  a 
system  whereby  the  impact  of  tentative  manpower 
decisions  can  be  rapidly  translated  into  accurate 
statements  of  training  resource  requirements.  As 
such,  this  effort  represents  the  required  initial  step  in 
system  development  and  is  presently  being  used  by 
the  Navy  to  assist  in  projecting  costs  of  specialized 
training. 

Payoff /Potential 

The  project  contributes  significantly  to  manage- 
ment efficiency  in  decisions  regarding  source  alloca- 
tion. The  ultimate  system,  as  described  above,  would 
permit  a more  comprehensive  decision-making  capa- 
bility. 


TRAINING  DEVICES  AND  SIMULATION 

• Cost-Effective  Simulation  in  Flight  Training 

• Air-To-Air  Gunnery  Trainer 

e Simulated  Avionics  Maintenance  Trainers 
e S-3A  ASW  Weapon  System  Training 
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COST-EFFECTIVE  SIMULATION  IN  FLIGHT  TRAINING 


Need/Objectives 

Simulators  customarily  reflect  much  of  the  physi- 
cal fidelity  and  functional  capabilities  of  the  opera- 
tional system  and  its  component  subsystems.  In  most 
cases,  the  emphasis  on  operational  realism  is  very 
costly  and  may  not  be  necessary.  In  fact,  there  are 
many  training  situations  in  which  simulation  with  a 
lower  degree  of  fidelity  may  be  justified.  The  key 
question  is  "how  much  physical  fidelity  is  necessary 
to  effect  high  transfer  of  training?" 

Regardless  of  the  degree  of  fidelity  and  related 
cost,  it  has  been  established  that  the  way  in  which 
trainers  are  used  significantly  affects  the  amount  of 
learning.  Therefore,  there  is  an  equal  need  to  detei  - 
mine  proper  training  methods.  The  project's  main 
objectives  are: 

• To  develop  advanced  training  methods  to 
improve  trainer  effectiveness  and  reduce  cost 

• To  develop  guidelines  for  the  systematic 
determination  of  training  equipment/training 
methodology  procurement  strategies. 

Funding  comes  from  Program  Element  No.  62757N. 

Approach  and  Results 

This  project,  developed  by  the  Naval  Training 
Equipment  Center  (NTEC),  is  surveying  selected 
flight  training  courses  and  development  programs  to 
identify  areas  where  expensive  operational  flight 
training  could  be  effectively  replaced,  reduced,  or 
improved  by  the  use  of  cost-effective  training  system 
management  and/or  low-cost  simulators.  Addi- 
tionally, prototype  flight  simulation  devices,  such  as 
the  Night  Carrier  Landing  Trainer  (NCLT),  Device 
2F103,  are  being  developed  and  field  tested.  Finally, 
a method  for  determining  the  type  and  level  of 
fidelity  required  for  effective  training  at  low  cost  is 
being  formulated. 

Significant  improvements  in  instructional  system 
development  can  be  achieved  through  this  project. 
This  research  effort  will  provide  information  for 
establishing  guidelines  to  relate  fidelity  of  simulation 
to  amount  of  transfer  of  training  on  a cost-effective 


basis.  Some  evidence  has  resulted  suggesting  that 
low-cost  simulators  can  be  as  effective  as  expensive 
equipment  if  attention  is  given  to  learning  task  details 
and  student  requirements. 

Utilization/Technology  Base  Advance 

The  intended  goal  of  the  project  is  the  desigrr-of 
an  efficient  learning  environment  rather  than  an 
attempt  to  simulate  the  real  world.  Cost-effective 
criteria  for  the  allocation  of  training  goals  among 
simulators,  part-task  trainers,  and  the  aircraft  are  also 
required. 

The  A-7  Fleet  Readiness  Squadron  (FRS), 
VA-174  at  Jacksonville,  Florida,  has  adopted  the 
NCLT  and  the  experimental  training  program  de- 
veloped under  this  project  in  an  effort  to  minimize 
the  need  for  recycling  pilots  who  fail  their  initial 
carrier  qualification.  Failure  to  qualify  on  the  first 
attempt  necessitates  an  additional  flight-hour  invest- 
ment of  about  19%.  The  data  reveal  that,  of  the  pilot 
group  not  utilizing  the  NCLT,  44%  fail  to  qualify 
initially.  Pilots  utilizing  the  NCLT  experience  only  an 
8%  failure  rate.  This  dramatic  reduction  in  pilot 
recycling  will,  of  course,  produce  substantial  savings 
in  flight  time. 

As  fall-out  to  the  project,  a computer-generated, 
performance-feedback  technique  was  developed 
which  provides  immediate  landing  decision  informa- 
tion to  the  pilots  undergoing  training.  VA-174  began 
evaluating  this  technique  in  May  1977. 

Payoff /Potential 

The  final  results  of  this  project  and  the  ongoing 
evaluation  at  Jacksonville  will  provide  the  Navy 
training  community  with  a means  to  answer  the 
question  of  device  fidelity  and  cost  trade-off  within  a 
given  set  of  training  objectives.  The  area  of  cost-effec- 
tive simulation  is  of  vital  interest  to  all  military 
services  as  well  as  to  commercial  and  civilian  aviation. 
Simulator  technology  will  benefit  primarily  from  data 
on  required  levels  of  fidelity,  an  area  of  primary 
interest  and  little  information. 


SI 
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AIR-TO-AIR  GUNNERY  TRAINER 


Need/Objectives 

Naval  aircraft  weapons  training  programs  are 
currently  encountering  difficulties  due  to  the  limited 
number  of  instructors  available,  the  increasing  cost  of 
ammunition,  and  the  problems  of  maintaining  air- 
space to  conduct  live-firing  exercises,  either  air-to-air 
or  air-to-ground.  Those  firing  areas  previously  estab- 
lished are  in  danger  of  being  lost  because  of  public 
criticism,  expansion  of  inhabited  areas,  and  increased 
usage  of  existing  airspace. 

The  objective  of  this  project,  performed  by  the 
Naval  Training  Equipment  Center  (NTEC),  is  to 
develop  a system  capable  of  providing  adequate, 
low-cost,  realistic  training  in  weapons  firing  tor 
air-to-air  gunnery.  The  T-2  training  aircraft  is  to  be 
used  as  the  experimental  vehicle.  Funding  comes 
from  Program  Element  No.  62757/64703N. 


Approach  and  Results 

The  approach  to  the  project  development  relied 
on  eye-safe  laser  technology.  Exploratory  research 
begun  in  1967  produced  a promising  technology  base 
Exploratory  applications  included  a Tank  Gunnery 
Trainer,  a Helicopter  Door  Gunner  Trainer,  a Laser 
Marksman  Rifle  Trainer,  and  the  Universal  Infantry 
Weapons  Trainer. 

The  T-2  air  to-air  gunnery  project  began  in  1973. 
T-2  aircraft  were  equipped  with  laser  transmitter  and 
receiver  units  (attacker)  and  glass  refroreflectors 
(target  aircraft).  Figure  1 is  an  artist's  concept  of  this 
T-2  installation.  Test  sorties  flown  with  the  laser- 
equipped  aircraft  were  quite  successful,  prompting  the 
commanding  officer  of  the  training  organization  to 
recommend  continued  development  "to  allow  earliest 
possible  introduction  of  the  system  into  the  basic  jet 
training  program." 


To  this  end.  two  systems  for  use  in  air-to-air 
gunnery  will  be  developed: 

• A low  cost,  fixed-pipper  system  to  be  in- 
stalled in  T-2  training  aircraft  for  initial  pilot 
training 

• A movable-pipper  system  for  installation  in 
Fleet  aircraft  capable  of  providing  realistic 
gunnery  and  air-to-air  combat  training. 

Using  design  criteria  and  technology  developed 
in-house,  specifications  for  a fixed-pipper  system  for 
the  T-2  training  aircraft  were  prepared;  proposals 
were  evaluated,  and  a contract  was  awarded  on 
27  September  1977  for  five  engineering  models. 
Development  will  require  approximately  12  months. 
After  acceptance,  the  units  will  undergo  test  and 
evaluation  by  Naval  Air  Test  Center  (NATC), 
Patuxent  River,  Maryland,  and  by  Operational  Test 
and  Evaluation  Force  (OPTEVFOR),  Norfolk, 
Virginia  for  about  six  months.  Certification  for 
service  use  is  anticipated  by  March  1979. 

The  movable-pipper  system  for  Fleet-type  aircraft 
will  use  the  same  design  as  the  fixed  pipper  for  the 
transmitter  and  receiver.  However,  the  system  must 
be  "slaved"  to  the  aircraft  fire  control  system  to 
insure  that  the  movable  pipper  properly  tracks  and 
lines  up  on  the  target.  Specifications  for  the  movatflfe 
pipper,  including  fire  control  radar  interfacing  and  air 
frame  mounting,  will  be  prepared  and  a contract 
awarded.  Development  will  require  approximately 
12  months  for  five  units.  Test  and  evaluation  by 
NATC  and  OPTEVFOR  will  require  about  9 months 
with  service  acceptance  expected  in  December  1979. 

Utilization/Technology  Bate  Advance 

Products  of  the  exploratory  research  phase  are 
currently  in  use.  The  Tank  Gunnery  Trainer,  first 
developed  by  the  Naval  Training  Equipment  Center, 
is  now  a Federal  stock  item  being  used  by  the  Army 
(600  units)  and  the  Marine  Corps  (30  units)  The 
Marine  Corps  plans  to  use  the  Laser  Marksmanship 
Rifle  Trainer  to  identify  trainees  who  will  have 
problems  firing  the  M-16  rifle.  They  can  then  receive 


additional  training  to  increase  their  probability  of 
success  in  live-fire  qualification.  In  addition  to  its 
training  effectiveness,  this  use  of  the  laser  trainer  is 
expected  to  halve  the  amount  of  ammunition  ex- 
pended by  each  trainee,  thus  producing  enormous 
cost-savings. 


Payoff /Potential 

The  primary  benefit  from  this  program  is  the 
enormous  cost-saving  to  be  realized  through  the 
substitution  of  lasers  for  live  ordnance.  Additionally, 
there  are  significant  benefits  in  areas  of  life-cycle 
integrated  logistics,  support  costs,  manpower,  flexi- 
bility, and  safety  to  be  realized  from  this  develop- 
ment: 

• Training  can  be  conducted  at  any  time  in  all 
normally  authorized  flying  areas.  There  is  no 
requirement  for  scheduled  target  times  at 
specific  firing  ranges. 

• The  amount  of  simulated  ammunition  capable 
of  being  expended  is  unlimited. 

• The  training  is  realistic  in  that  hits  scored  and 
recorded  by  the  laser  system  must  be  in  the 
same  dispersion  pattern  as  that  resulting  from 
the  use  of  live  rounds.  The  system  is  range 
gated  so  that  no  hits  are  scored  unless  firing  is 
initiated  within  a prescribed  range  increment. 
Instant  feedback  for  scoring  purposes  is  pro- 
vided. 

• Present  requirements  for  ordnance  personnel 
will  be  reduced;  arming  and  dearming  of  the 
weapons  are  not  required;  ammunition  does 
not  h we  to  be  loaded,  and  maintenance  of 
the  laser  system  will  require  less  effort  than 
that  required  with  actual  weapons. 

• The  gun  pod  carried  on  the  aircraft  will  be 
greatly  reduced  in  size,  thus  reducing  the  fuel 
requirements  of  the  aircraft. 

• Target  weather  will  no  longer  be  a limitation 
to  successful  completion  of  training. 

• The  safety  aspects  are  readily  apparent;  there 
are  no  hazards  to  personnel  or  equipment. 
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SIMULATED  AVIONICS  MAINTENANCE  TRAINERS 


Nead/Obfectivei 

For  many  years,  the  Navy  has  been  conducting  its 
maintenance  training  ih  a time  accepted  manner.  A 
specified  period  of  classroom  training  is  devoted  to 
theory  accompanied  by  some  degree  of  demonstia 
tion  or  hands  on  application  with  the  use  of  actual 
operational  equipment.  The  trainee  then  applies  this 
theoretical  knowledge  during  a phase  of  on-the-job 
training  before  attaining  minimal  capability  as  a 
technician  in  the  Fleet. 

This  system  of  training  has  become  unacceptable 
in  modern  times  due  to  the  increasing  complexity  of 
new  weapons  systems,  the  variety  of  equipment  being 
introduced  or  already  existing,  and  the  continuing 
need  for  modifications.  Furthermore,  the  cost  of 
operational  equipment  for  training  purposes  hat 
become  prohibitive,  and  too  much  time  is  required  to 
train  today's  technicians  to  function  effectively. 

Therefore,  the  maintenance  training  approach 
must  be  revised  to  piovide  maximum  training  effec- 
tiveness at  minimum  overall  cost,  in  the  shortest 
period  of  time.  The  Department  of  Defense  has 
designated  the  Navy  as  the  lead  service  in  assessing 
this  training  problem  and  assigned  it  to  conduct 
research  leading  to  a more  efficient  solution  while,  at 
the  same  time,  effecting  coordination  with  the  efforts 
of  the  other  services.  As  a result,  the  Naval  Training 
Equipment  Center  (NTEC)  developed  this  project. 
The  objectives  are: 

• To  develop  and  evaluate  an  intermediate  level 
experimental  model  simulator  for  avionic 
subsystems  in  the  electronic,  electro 
mechanical,  and  mechanical  areas 

• Concurrent  with  the  experimental  effort,  to 
develop  a prototype  simulator  for  these 
avionic  subsystems  in  the  F-18. 

• To  develop  general  intermediate-  and  organ- 
izational-level specification  guidelines  for  fu 
hire  procurement. 

Funding  comes  from  Program  Element  No. 
62757/64  703N. 

Approach  and  Results 

Initial  research  at  the  NTEC  Human  Factors 
Laboratory  concluded  that  some  degree  of  simulation 
was  needed  to  decrease  maintenance  training  costs 


and  inciease  effectiveness.  Simulation  can  be  achieved 
with  either  two-dimensional  lepiesentation.  such  as 
pictuies.  TV,  and  giaphics.  01  with  three  dimensional 
fabrications  which  allow  hands  on  application  with 
softwaie  induced  lesponsas  Finthei  study  of  cuinci- 
lum  lequirements  and  instiuctoi  lecommendations 
revealed  that  the  use  of  simulators,  together  with  the 
application  of  computer-aided  instruction,  would 
provide  individualized,  self-paced  training,  increased 
instructor-student  interaction,  and  consistent  student 
evaluation  capabilities.  The  results  of  the  NTEC 
initial  efforts  in  simulation  were  conclusive  enough  to 
proceed  into  advanced  and  engineering  development 
phases  for  the  avionics  maintenance  trainers. 


Utilization/Technology  Bata  Advance 

An  electronic  experimental  model  of  the  A-7E 
Head-Up  Display  (HUD)  test  set  has  been  developed 
ana  delivered  to  NTEC  where  it  is  being  modified  to 
include  optics  training.  The  simulator  will  be  de 
livered  to  the  training  detachment  at  Naval  Air 
Station,  Cecil  Field,  in  early  1978.  The  remaining 
experimental  models  and  the  F-18  prototype  develop 
ments  are  ongoing  and  are  scheduled  to  be  completed 
in  late  FY  81.  Work  on  the  other  out-year  objectives 
is  also  proceeding. 

As  a result  of  technology  developed  in  the 
exploratory  and  advanced  areas  of  this  endeavoi. 
project  expansion  is  expected  in  future  years  as  the 
prototype  systems  are  successfully  evaluated.  In 
aviation,  all  future  aircraft  introductions  into  the 
Fleet  can  be  accompanied  by  maintenance  technician 
training  simulation  systems.  For  example,  the  simula- 
tor tor  the  F-18  avionics  is  scheduled  to  be  opera 
tional  at  the  same  time  as  the  arrival  of  the  aircraft  its 
the  Fleet. 


Pay  off /Potential 

The  cost  of  the  electronic  experimental  (A-7E 
HUD  Test  Set)  simulator  demonstrates  the  savings  to 
be  realized  when  compared  to  Actual  Equipment 
Trainer  (AET)  usage  $1200  K for  the  AET  versus 
$500  K for  the  simulator.  Table  1 indicates  projected 
savings  for  several  planned  applications. 
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Table  1 

Maintenance  Simulation  Technology  Application* 
at  NTEC 


Applications 

Costs 

AET 

Simulator 

Air 

a A-7E  HUO/Tatt  Sat 

1.2M 

0.6  M 

a VAST 

4.0M 

2.0M 

a IF-18  Flight  Control  Elec- 
tronic Sat) 

To  1 

3e  Determined 

Surface 

a DO  1062  Hagan  Automatic 
Boiler  Control  Operator  and 
Maintenance  T rainer 

0.6M 

05  M 

Subsurface 

a Trident  Air  Conditioner  and 
Compressor  Operator  and 
Maintenance  T rainers 

0.4  M 

0.2M 

a Trident  Submarine  Integrated 
Radio  Room  Operator  and 
Maintenance  Production 
Trainers 

20.0  M 

3.6M 

Other  benefits  include  the  following: 


Full  task  hands-on  application  will  reduce 
training  time. 

Fewer  instructors  will  he  requited  to  tram 
more  students. 


• Availability  and  configuration  update  condi- 
tidns  will  be  continually  maintained  by  soft- 
ware inputs. 

• Unlimited  fault  insertion  capability  will  be 
possible. 


Automation  will  provide  for  objective  instruc- 
tion, briefing,  debriefing,  and  evaluation. 

Training  will  be  standardized. 

Safety  standards  regarding  equipment  as  well 
as  the  trainee  will  be  realized. 


• Time  required  for  on-the-job  training  will  be 
significantly  reduced. 

These  research  efforts  in  avionics  maintenance 
training  are  expected  to  contribute  to  a massive 
expansion  in  the  use  of  simulation  in  the  post-1980 
years  in  surface  and  subsurface  training  as  well. 


S-3A  ASW  WEAPON  SYSTEM  TRAINING 


Need /Objectives 

This  project  was  initially  presented  to  the  Chief 
of  Naval  Operations  and  the  Naval  Air  Systems  Com 
mand  through  the  S3A  Program  Office.  The  S-3A  is  a 
new  and  sophisticated  air  antisubmarine  warfare 
(ASW)  weapon  system  which  requires  an  efficient, 
cost-effective  training  system  to  maximize  available 
resources  while  providing  the  Fleet  with  well  trained 
operators.  To  address  this  situation,  the  Navy  Person- 
nel Research  and  Development  Center  (NPRDC)  was 
assigned  the  task  of  developing  a complete  training 
program  for  the  four  crewmembers  of  the  S-{JA. 
Funding  is  from  Aircraft  Procurement,  Navy  and 
Weapon  System  R&D  funds. 

Approach  and  Results 

Utilizing  the  general  methodology  referred  to  as 
"Instructional  Systems  Development"  USD),  the  ro- 
searchers  established  a training  course  which  included 
simulators,  individualized  student  workbooks,  video- 
tape programs,  and  computer-assisted  instruction 
(CAI).  The  use  of  CAI  in  an  operational  Fleet  training 
environment  was  considered  unique.  The  particular 
CAI  system  selected  was  TICCIT  (Time-shared  Inter- 
active Computer  Controlled  Information  Television), 
which  had  been  developed  under  the  sponsorship  of 
the  National  Science  Foundation.  The  project  gen- 
erated all  of  the  instructional  materials,  tests,  simula- 
tor exercises  and  flight  exercises,  determined  the 
types  and  numbers  of  simulators  required,  and 
designed  an  ongoing  evaluation  program  valid  for  the 
life  of  the  weapon  system.  The  evaluation  program 
revealed  a problem,  for  example,  in  teaching  the 
S-3A  copilot  to  operate  the  Integrated  Control  Sys- 
tem (INCOS),  which  interacts  with  the  on-board 
computer  for  ASW  activities.  To  resolve  this  problem, 
a new  training  course  based  on  PLATO  IV  (Pro- 
grammed Logics  for  Automated  Teaching  Operations) 
was  developed. 

Utilization/Technology  Base  Advance 

As  a direct  result  of  the  project's  cost  analyses, 
the  Navy  requested  that  six  operational  aircraft 


originally  budgeted  not  be  purchased  The  money 
saved  was  used  to  purchase  a variety  of  simulation 
devices  (digitally  driven  position  simulators,  opera 
tional  flight  trainers,  and  weapon  system  trainers) 
The  weapon  system  simulators,  in  particular,  piovidr 
practice  in  essential  skill  areas  which  cannot  be 
developed  using  operational  aircraft. 

The  S-3A  training  program  was  devised  and  is 
in  use  at  Air  Antisubmarine  Squadron  Forty-One 
(VS-41),  Naval  Air  Station,  North  Island.  Cut 
rently,  the  contractor  is  conducting  a formal,  ana 
lytical  and  empirical  evaluation  of  the  instructional 
program.  The  evaluation  is  scheduled  for  comple 
tion  in  FY  78. 

This  incorporation  of  ISD,  simulator  training, 
and  CAI  into  an  operational  training  program  pro 
vides  the  Navy  with  an  efficient  and  exceptionally 
cost-effective  alternative  to  operational  flight-crew 
training. 

Payoff /Potential 

The  Navy  is  realizing  a net  saving  of  $5  to 
$6  million  per  year  from  the  introduction  of  this 
S-3A  training  system.  To  fly  the  S-3A  for  one  training 
hour  costs  over  $4000;  one  hour  of  full  weapon 
system  simulator  time  costs  approximately  $400.  The 
training  program  also  allows  a net  decrease  in  flight 
time  of  approximately  15  hours  per  pilot/copilot  by 
careful  substitution  of  simulator  hours.  In  conjunc 
tion  with  this  project,  the  trainer  purchase  costs 
themselves  were  reduced  by  more  than  $10  million 
over  initial  estimates. 

This  R&D  work  for  the  carrier-based  S 3A  is 
being  applied  to  the  P-3A1B  retiofit  and  the  P-3C, 
the  Navy's  land-based  patiol  planes.  The  resultant 
training  programs  will  be  implemented  by  patrol 
squadrons  in  1978.  All  future  sophisticated,  team 
oriented  weapons  systems  can  certainly  be  expected 
to  benefit  from  this  program  and  the  methodology 
developed  for  the  S-3A. 


CURRENT  NAVY  ACTIVITIES 
FOR  INCREASING  RDT&E  UTILIZATION 


In  1977,  the  Secretary  of  Defense  received 
recommendations  from  the  GAO  for  increasing  the 
use  of  RDT&E  results.  The  GAO  report  stated: 

We  recommend  that  the  Secretary  of 
Defense  take  the  necessary  action  to 
strengthen  the  management  of  the  use  of 
human  resources  research  and  develop- 
ment results.  Such  action  should  provide 
for  establishing 

- criteria  to  identify  results  with 
immediate  use  potential. 

— improved  communications  be- 
tween researchers  and  users. 

- effective  monitoring  of  utiliza- 
tion, and 

— a management  mechanism  for  res- 
olution of  issues  between  re- 
searchers and  users  preventing  use 
of  research  and  development  re- 


The  Navy  recognizes  that  it  is  not  sufficient  to 
conduct  people-related  RDT&E.  It  is  also  necessary 
that  operational  and  training  commands  then 
utilize  the  results.  Furthermore,  the  Navy  rec- 
ognizes that  research  utilization  is  not  a matter  of 
course;  it  must,  therefore,  be  an  integral  part  of  the 
doctrine  of  research  management.  Navy  research 
management  personnel  have  the  responsibility  to 
identify  and  even  anticipate  operational  needs,  to 
implement  research  results  in  the  Fleet,  and  to 
provide  on-going  test  and  evaluation  programs. 
Simply  stated,  the  research  management  objectives 
are  to  improve  research  relevance  and  utilization. 


Several  new  Navy  activities  have  been  under- 
taken to  respond  to  the  GAO  recommendations. 
Brief  descriptions  of  some  of  these  activities 
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RDT&E  APPLICATIONS  PROGRAM 


In  F Y 76.  the  Navy  Personnel  Research  and 
Development  Center  established  an  Applications 
Program  to  facilitate  the  introduction  and  use  of 
RDT&E  end  products.  This  effort  is  improving  the 


relationships  among  the  researchers,  sponsors,  and 
users  of  end  products  from  the  initial  determination 
of  an  operational  problem  through  to  the  implemen 
tation  of  the  solution. 


THE  1977  NATIONAL  SYMPOSIUM  OF  THE  MILITARY  SERVICES 
ON  UTILIZATION  OF  PEOPLE-RELATED  RDT&E 


In  June  1977,  the  Navy  Personnel  Research  and 
Development  Center  (NPRDC)  sponsored  and  con- 
ducted a 3Vi  day  national  symposium  on  the  utiliza- 
tion of  people-related  research.  Symposium  partici- 
pants included  RDT&E  managers,  scientists,  and 
operational  practitioners  from  the  Department  of 
Defense,  other  government  agencies,  industry,  and 
universities.  The  purpose  of  this  symposium  was  to 
assess  the  problems  and  needs  of  research  utilization, 
principally  within  the  military  establishment.  Special 
attention  was  given  to  an  assessment  of  current 
problems  in  research  utilization,  an  exchange  of 
information  on  the  state-of-the-art,  the  development 
of  policy  recommendations  for  improving  research 
utilization  within  the  military  services,  and  an  outline 
of  the  parameters  for  future  research  utilization. 

The  1977  symposium  thereby  provided  a forum 
for  active  discussion  of  the  problems  of  research 
utilization  in  the  military  services.  The  program 


agenda  encompassed  a review  of  current  research 
utilization  activities  in  the  Armed  Forces,  Federal 
agencies,  and  private  industry.  Some  key  DOD 
decision  makers  and  potential  users  of  military 
research  from  the  operational  community  presented 
their  views  on  research  utilization. 

The  symposium  provided  the  first  major  opportu 
nity  for  a diverse  group,  representing  a broad  spec 
trum  of  interests,  to  discuss  this  important  topic  with 
reference  to  military  research  and  development.  An 
Executive  Summary  of  this  symposium  was  published 
in  order  to  provide  participants  with  (a)  an  overview 
of  the  symposium's  aims  and  organization,  (b)  a 
synopsis  of  the  main  conclusions  and  recommenda- 
tions reached  by  conferees  during  four  days  of 
meetings,  and  (c)  a discussion  of  the  symposium's 
impact.  The  proceedings  have  been  published  as 
NPRDC  Special  Report  78-3. 


NAVY  RDT&E  UTILIZATION,  MONITORING,  AND  TRACKING 


A monitoring  system  to  track  the  utilization  of 
RDT&E  products  is  being  studied  at  the  Navy 
Personnel  Research  and  Development  Center.  The 
objectives  of  the  system  are  to: 

• Enhance  the  utilization  of  RDT&E  products 
that  would  support  policy  development  end 
resolve  operational  problems 

• Identify  categories  of  potential  users  who 
would  benefit  from  a proposed  research  ac- 
tivity and  characterize  the  type  of  benefit 
anticipated 

• Provide  a systematic  process  for  generating 
preliminary  utilization  plans  including  strat- 
egies for  disseminating  and  facilitating  ap- 
plication of  project  outcomes 

• Provide  a system  and  process  for  estimating 
R&O  costs,  implementation  costs,  and  cost- 
benefit  ratios 


• Provide  a mechanism  for  monitoring  the  plans 
and  activities  of  R&D  projects  related  to 
research  utilization.  (This  mechanism  should 
include  a method  for  tracking  an  R&D 
product  from  initial  development  until  at 
least  two  years  after  completion  of  the 
project.)  Such  tracking  should  provide  in 
formation  on  the  use  of  e product,  users,  type 
and  degree  of  impact,  spread  or  spinoff 
effects,  approximate  implementation  costs, 
and  cost-effectiveness. 

• Provide  a means  for  comparative  analysis 
among  three  major  categories  of  data:  (1)ac 
fuel  data  obtained  from  the  tracking 
measures,  (2)  forecast  data  on  analogous 
measures  developed  during  the  R&D  phases, 
and  (3)  equivalent  data  based  on  previous  or 
alternative  ways  of  dealing  with  the  particular 
problem  or  need  that  the  new  product  was 
designed  to  meet. 
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CRITERIA  TO  IOENTIFY  RESULTS  WITH  IMMEDIATE  USE  POTENTIAL 


Tentative  criteria  have  been  developed  to  test  the 
intended  use  (or  impact  targets)  of  RDTAE  results. 
Some  of  the  recipients  of  the  RAD  results  and  the 
areas  of  interest  to  each  group  are  listed  below: 

• Operational  commanders 

- Changes  in  doctrine 

- Changes  in  procedures 

- Information  on  hunpan  capabilities  and 
limitations 

- Modification  in  requirements  for  man- 
power or  equipment 


quirements 
a Training  managers 

- Develooment  of  or  change  in  courses  of 
instruction  or  training  programs 

- Development  of  requirements  for  training 
curricula  and  equipment 


- Development  of  or  change  in  instructional 
delivery  methods  and  media 

- Changes  in  management  policy  or  prac- 
tices 

- Training  device  prototypes 

- Information  on  which  to  base  long-range 
objectives  and  further  RAD  requirements 

— Evaluation  of  specific  materials  and  pro 
cedures 

a System  developers 

- Information  on  human  capabilities  and 
limitations 

- Evaluation  of  specific  designs 
— Human  factors  engineering  (HFE)  design 

principles 

- Efficient  ways  of  applying  HFE 

- Changes  in  development  management  fac 
tors 

RAD  community 

— Information  about  human  capabilities  and 
limitations 

- Information  on  the  effectiveness  of  vari- 
ous personnel  training  methods 

- Solutions  to  technical  problams 
— Indications  of  furthar  RAD  requirements. 


e Personnel  and  manpower  managers 

- Changes  in  management  policy  or  tech 
niques 

- Change  in  planning  capability 

- Changes  in  manpower  requirements 

- Solutions  to  specific  problems 

- Information  on  which  to  base  RAD  re-  • 


TRISERVICE  AND  NASA  HUMAN  FACTORS  ENGINEERING 
TECHNICAL  ADVISORY  GROUP  (TAG) 


There  is  persistent  criticism  within  DOD  and 
Congress  about  the  lack  of  coordination  among  the 
services'  research  efforts.  In  1977,  the  Navy  took  the 
lead  in  initiating  a trisarvice  and  NASA  Human 
Factors  Engineering  Technical  Advisory  Group 
(TAG).  The  broad  objective  of  TAG  it  to  enhance 
working-level  coordination  among  government  labora- 
tories and  organizations  performing  human  factors 
engineering  RDTAE. 

Although  the  TAG  is  not  a Navy  organization,  the 
first  meeting  of  the  group  was  held  at  the  Naval  Air 


Development  Center  in  August  1977.  Representatives 
from  all  three  services  and  NASA  attended.  Meetings 
of  the  TAG  will  be  held  semiannually,  and  the 
chairperson  will  rotate  annually  among  the  Army, 
Navy,  Air  Force,  and  NASA. 

The  formal  operating  structure,  goals,  and  scope 
of  the  TAG  are  still  being  worked  out.  However,  the 
charter  members  agreed  that  the  concept  will  allow  a 
sharing  of  many  kinds  of  data,  common  funding  of 
efforts,  and  a better  development  of  human  factors 
engineering  products  and  capabilities. 
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In  support  ol  the  effort  to  coordinate  the 
manpower,  personnel,  education  and  training,  and 
human  factors  engineering  R&D  programs  within  the 
Navy,  the  Navy  Personnel  Research  and  Development 
Center  is  developing  a Research  and  Development 
Information  System  (RDIS).  This  system  will  provide 
for  the  collection,  review,  organization,  update, 
analysis,  and  dissemination  of  information  regarding 
all  Navy,  Marine  Corps,  Army,  and  Air  Force  people 
related  R&D  efforts.  The  initial  data  base  contains 
information  on  Navy  activities  at  the  work-unit  level. 

When  fully  implemented,  RDIS  will  comprise 
a comprehensive  R&D  data  base  that  will  allow 


the  various  projects  to  be  mapped  or  clustered 
so  that  interactions  can  be  identified.  F pi 
example,  common  elements  among  woik  units 
could  Ik*  identified  to  deleunine  Itomogenenut 
program  topics,  auras  ot  mutual  gam  iluougli 
pooled  efforts  could  be  defined,  funding  pi  of  lies 
across  various  research  areas  could  be  prepared, 
and  research  objectives  could  be  compaied  in 
behavioral  terms  throughout  R&D  activities.  As  a 
result,  the  management  and  research  community 
concerned  with  people  related  problems  will  have 
a definite  and  responsive  behavioral  data  base 
with  which  to  interact,  leading  to  greater  total 
effectiveness  of  their  R&D  efforts. 


ANNUAL  REPORT  ON  THE  UTILIZATION  OF  PEOPLE  RELATED  NAVY  RDT&E 

This  report  is  the  first  in  a series  of  annual  base  advancement  relevant  to  future  utilization, 

reports  the  Navy  intends  to  publish  describing  the  These  annual  reports  are  expected  to  stimulate 

utilization  of  people-related  RDT&E.  It  includes  communication  and  understanding  among 

examples  of  present  utilization  and  technology  researchers,  users,  and  policy  makers. 


TECHNOLOGY  TRANSFER  COORDINATION 

The  policy  of  the  Department  of  the  Navy  is  to  can  be  profitably  utilized  in  non-military  applies 

promote  military-civilian  technology  transfer  and  tions,  (2)  identification  of  common  interests,  and 

cooperative  development  on  a systematic  basis.  It  (3)  exploration  of  the  feasibility  ot  cooperative  fund- 
encompasses  ID  transfer  of  technology  developed  by  ing  and  development  of  such  programs.  Hence,  Navy 

the  Department  of  the  Navy-for  National  Defense  RDT&E  commands  have  appointed  Technology 

purposes  to  the  civilian  sector  where  such  technology  Transfer  Coordinators. 
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